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Real Party in Interest 

BearingPoint, Inc., currently owns this Application. An assignment recorded 30 October 
2003 in the Assignment Records of the United States Patent and Trademark Office at Reel 
014658, Frame 0275, indicates BearingPoint, Inc. currently owns this Application. 
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Related Appeals and Interferences 

No known appeals, interferences, or judicial proceedings are related to or will directly 
affect or have a bearing on the Board's decision on this Appeal. The Board's decision on this 
Appeal will not affect any known appeals, interferences, or judicial proceedings. 
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Status of Claims 

Claims 1-20 are pending in this Application and all stand finally rejected under the Office 
Action sent 13 September 2007. Appellant presents all pending claims for appeal. The attached 
Claims Appendix shows all pending claims. 
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Status of Amendments 

The Examiner has entered all amendments submitted by Appellant. 
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Summary of Claimed Subject Matter 

FIGURE 1 illustrates an example system 10 for facilitating software engineering and 
management in connection with a software development project according to a process that is 
compliant with a qualitatively measurable standard. (Page 6, Lines 2-4). An example of a 
qualitatively measurable standard includes one or more maturity levels (MLs) of a software 
capability maturity model (SW-CMM), such as the Software Engineering Institute's (SEI's) 
Software Capability Maturity Model (SW-CMM). (Page 6, Lines 4-6). An ML of an SW-CMM 
may include multiple key process areas (KPAs). (Page 6, Lines 6-7). A KPA may be an area of 
focus for improving an organization's software processes. (Page 6, Lines 7-8). A process may 
include a sequence of steps performed for a given purpose (such as software development). 
(Page 6, Lines 8-9). An organization may include an entity (such as an enterprise) that 
undertakes projects (such as software development projects). (Page 6, Lines 9-1 1). Associated 
with a KPA are goals and common features. (Page 6, Line 11). A goal may be associated with 
enhancing process capabilities, and an organization may be required to achieve all goals 
associated with a KPA to satisfy the KPA. (Page 6, Lines 11-13). A common feature associated 
with a KPA may be an attribute that indicates whether an organization has implemented the 
KPA. (Page 6, Lines 13-15). Associated with a common feature of a KPA are one or more KPs 
that include activities, infrastructure, or both that contribute to reaching goals associated with the 
KPA. (Page 6, Lines 15-17). A KP may include one or more subpractices, according to 
particular needs. (Page 6, Lines 17-18). 
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As an example and not by way of limitation, an organization that has reached ML2 of the 
SEI's SW-CMM is capable of successfully planning, performing, and managing software 
projects. (Page 6, Lines 19-21). In addition, the organization has a software process that is 
repeatable. (Page 6, Lines 12-22). An organization that has reached ML3 of the SEI's SW- 
CMM has derived, from past successful software projects, "best practices" for planning, 
performing, and managing software projects. (Page 6, Lines 22-24). In addition, the 
organization has documented these best practices in an OSSP. (Page 6, Lines 24-25). An OSSP 
may include an operational definition of a best process that guides establishment of a common 
software process across software projects of an organization and a description of fundamental 
software-process elements that are to be incorporated into projects' defined software processes 
(PDSPs) of the organization. (Page 6, Lines 25-29). 

System 10 includes a server system 12 that provides one or more users at one or more 
client systems 14 access to one or more resource databases 16 that include one or more resource 
sets 18. (Page 7, Lines 18-20). The components of system 10 may communicate with each other 
using one or more links that may each include one or more computer buses, local area networks 
(LANs), metropolitan area network (MANs), wide area networks (WANs), portions of the 
Internet, or other wireline, optical, wireless, or other links. (Page 7, Lines 20-24). Server system 
12 may include one or more appropriate computer systems (which may be geographically 
separated from each other) that may collectively receive a resource request from a client system 
14 and, in response to the resource request, access one or more resources from one or more 
resource sets 18 and communicate the accessed resources to client system 14. (Page 7, Lines 24- 
28). In particular embodiments, system 12 may receive project documentation, work product, or 
other information from client system 14 and store the information at resource database 16. (Page 
7, Lines 28-30). Such information may be used to obtain certification associated with one or 
more MLs of an SW-CMM, as described more fully below. (Page 7, Line 30, through Page 8, 
Line 1). A client system 14 may include one or more computer systems associated with an 
organization that may provide one or more users access to server system 12. (Page 8, Lines 1-3). 
The computer systems of client system 14 may be distributed throughout the organization and 
may, in particular embodiments, be geographically separated from each other. (Page 8, Lines 3- 
5). 
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Resource database 1 6 may include one or more database systems that may collectively 
contain one or more resource sets 18. (Page 8, Lines 6-7). In particular embodiments, the 
database systems of resource database 16 may be geographically separated from each other. 
(Page 8, Lines 7-9). A resource set 18 in resource database 16 may include one or more 
resources that may be used to facilitate software engineering and management in connection with 
a software development project according to a process that is compliant with a qualitatively 
measurable standard. (Page 8, Lines 9-12). As an example and not by way of limitation, a 
resource set 18 may include information specifying one or more tasks that an organization may 
execute to reach one or more particular MLs of SEI's SW-CMM, as described more fully below. 
(Page 8, Lines 12-15). In particular embodiments, a resource set 18 may include an OSSP that 
facilitates compliance with one or more MLs of a CMM. (Page 8, Lines 15-16). In particular 
embodiments, resource set 18 may include one or more tools for tailoring an OSSP to a 
particular software project to generate a PDSP for the particular software project, as described 
more fully below. (Page 8, Lines 16-19). 

FIGURE 2 illustrates an example derivation of tasks from an example ML 22. (Page 8, 
Line 20). In particular embodiments, ML 22 may include ML2, ML3, or other suitable ML of 
SEI's SW-CMM or CMMI (or both) or other CMM. (Page 8, Lines 21-22). As described above, 
ML 22 may include one or more KPAs 24 and each KPA 24 may, in turn, include one or more 
KPs 26. (Page 8, Lines 22-24). For each KPA 24, tasks 20 that address KPs 26 of KPA 24 may 
be identified. (Page 8, Lines 24-25). A task 20 may include one or more subtasks, according to 
particular needs. (Page 8, Lines 25-26). Reference to a KP 26 may include one or more 
subpractices of KP 26, where appropriate. (Page 8, Lines 26-27). To identify one or more tasks 
20 that address a KP 26, one or more policies associated with KP 26 may be identified. (Page 8, 
Lines 27-28). In addition, one or more proofs, artifacts, or other resources for demonstrating 
compliance with a CMM may be identified. (Page 8, Lines 28-30). One or more tasks 20 that 
address KP 26 may be derived from these identified policies, proofs, and artifacts. (Page 8, 
Lines 30-31). In particular embodiments, tasks 20 may each relate to one or more of the 
following: tools, checklists, templates, procedures, tasks, methods, activities, processes, 
standards, and policies. (Page 8, Line 31, through Page 9, Line 2). In particular embodiments, 
tasks 20 may each correspond (and be traceable) to one or more particular KPAs 24. (Page 9, 



DAL01:995911.1 



ATTORNEY DOCKET: PATENT APPLICATION 

068215.0120 10/696,817 



Lines 2-4). In addition to tasks 20, task collaterals associated with tasks 20 may also be 
identified. (Page 9, Lines 4-5). Task collaterals may include implementation aids (such as task 
descriptions for compliance with ML 22, templates, checklists policy statements, training and 
presentation materials, software tools, sample work products, and other implementation aids) and 
other resources. (Page 9, Lines 5-8). In particular embodiments, for each identified task 
collateral, CMM, Institute of Electrical and Electronics Engineers (IEEE), and other standards 
and sources related to the task collateral may be reviewed, a task collateral format identification 
scheme may be defined, and one or more task collateral templates may be created. (Page 9, 
Lines 8-12). 
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In particular embodiments, to facilitate an organization's or a software project's 
compliance with multiple MLs 22, multiple MLs 22 may be combined with each other for 
purposes of identifying tasks 20. (Page 9, Lines 13-15). As an example and not by way of 
limitation, a total of three hundred fifteen tasks 20 may be identified for all KPAs 24 of ML2 of 
the SEI's SW-CMM and all KPAs 24 of ML3 of the SEI's SW-CMM. (Page 9, Lines 15-17). In 
particular embodiments, tasks 20 may be consolidated into a set of "supertasks" to reduce 
redundancies across tasks 20 and to streamline compliance with one or more MLs 22. (Page 9, 
Lines 17-20). As an example and not by way of limitation, three hundred fifteen tasks 20 for 
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ML2 and ML3 of SEI's SW-CMM may be consolidated into the following seven supertasks: (1) 
establishing an organizational-level SPI team; (2) identifying ML3 gaps; (3) establishing an 
engagement-level SPI implementation infrastructure; (4) developing a PDSP and plans; (5) 
carrying out the PDSP and plans; (6) requesting and obtaining support from a Public Services 
Consulting (PSC) Software Engineering Process Group (SEPG) as needed; and (7) requesting 
and taking an ML3 appraisal from the SPC SEPG. (Page 9, Lines 20-27). After an organization 
or software project team has carried out these supertasks, the PSC SEPG may provide monthly 
status reports on ML3 SPI efforts by the organization or software project team to a PSC 
Management Steering Group. (Page 9, Lines 27-30). In particular embodiments, resources 
associated with one or more of these supertasks may be contained in one or more resource sets 
18 in resource database 16, as described more fully below. (Page 9, Line 30, through Page 10, 
Line 2). 

In particular embodiments, establishing an engagement-level SPI implementation 
infrastructure may include: establishing required groups for ML2 and ML3 and assigning 
responsibilities; creating and disseminating policies associated with ML2 and ML3; training 
software project team members on processes associated with ML2 and processes associated with 
ML3; providing required training; and providing required orientations. (Page 10, Lines 3-8). In 
particular embodiments, developing a PDSP and plans may include: identifying a software life 
cycle model; tailoring a PDSP for a particular software project from an OSSP; developing and 
managing estimates; developing plans for ML2 and ML3; managing and controlling the 
developed plans for ML2 and ML3; and distributing the developed plans for ML2 and ML3. 
(Page 10, Lines 8-12). In particular embodiments, performing a PDSP may include: performing 
one or more software engineering tasks; performing one or more software management tasks; 
performing one or more measurement and analysis tasks; and performing one or more 
verification tasks. (Page 10, Lines 12-16). 

In particular embodiments, tasks 20 associated with an ML 22 may constitute an OSSP 
that an organization may use to implement ML 22. (Page 10, Lines 17-18). In addition or as an 
alternative, software project teams in the organization may use the OSSP to generate PDSPs for 
particular software projects. (Page 10, Lines 18-20). The OSSP may include task descriptions, 
task collaterals, and other resources associated with tasks 20. (Page 10, Lines 20-21). In 
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particular embodiments, the OSSP may include tasks 20 derived from multiple MLs 22. (Page 
10, Lines 21-22). In these embodiments, a single OSSP that includes tasks 20 may be used to 
implement MLs 22. (Page 10, Lines 22-24). In addition or as an alternative, the OSSP may be 
used to generate PDSPs for particular software projects. (Page 10, Lines 24-25). In particular 
embodiments, an OSSP may include supertasks instead of tasks 20, which may reduce 
redundancies in the OSSP, as well as streamline the OSSP. (Page 10, Lines 25-27). As 
described more fully below, one or more resource sets 18 in resource database 16 may contain 
the OSSP (and associated task collaterals and other resources), which may be made available to 
one or more users at one or more client systems 14. (Page 10, Lines 27-30). 

FIGURE 3 illustrates an example web page 28 providing access to an example resource 
set 18 for compliance with ML2 and ML3 of the SEI's SW-CMM. (Page 11, Lines 1-2). 
Resource set 1 8 includes an OSSP and associated resources for compliance with ML2 and ML3 
of the SEI's SW-CMM. (Page 11, Lines 2-4). Web page 28 includes a first area 30a that 
provides a summary of resource set 18. (Page 11, Lines 4-5). Web page 28 also includes a 
second area 30b that contains links 32 to particular resources in resource set 18. (Page 11, Lines 
5-6). Web page 28 includes multiple levels of links 32. (Page 11, Lines 6-7). A first level 
includes links 32 to resources associated with the seven supertasks described above. (Page 11, 
Lines 7-8). With respect to certain supertasks, a second level of links 32 includes links 32 to 
resources associated with certain components of those supertasks. (Page 11, Lines 8-10). As an 
example, the third supertask described above — establishing an engagement-level SPI 
implementation infrastructure — includes five components: (1) establishing ML2- and ML3- 
required groups and assigning responsibilities; (2) creating and disseminating ML2 and ML3 
policies; (3) training team members on one or more SW-CMM processes; (4) providing required 
training; and (5) providing required orientation. (Page 11, Lines 10-15). Each of these 
components has a link 32 in web page 28 to one or more resources associated with the 
component. (Page 11, Lines 15-16). With respect to certain supertasks, a third level of links 32 
includes links 32 to particular elements of components of those supertasks. (Page 11, Lines 16- 
18). 
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A user at a client system 14 may click on or otherwise select a link 32 in web page 28 to 
gain access to one or more resources associated with the supertask, component, or element 
designated in link 32. (Page 11, Lines 19-21). When the user selects link 32, server system 12 
may access the one or more resources and communicate the one or more resources to the user. 
(Page 11, Lines 21-23). As an example and not by way of limitation, server system 12 may 
communicate the one or more resources to the user in one or more hyper text markup language 
(HTML) files. (Page 11, Lines 23-25). As described above, the communicated resources may 
include one or more of the following: descriptions of one or more tasks 20 (or subtasks) or 
supertasks (or components or elements of supertasks); one or more task collaterals; one or more 
templates; and one or more other suitable resources. (Page 11, Lines 25-28). In particular 
embodiments, the resources accessible through web page 28 may collectively facilitate 
implementation of an OSSP in an organization. (Page 11, Lines 28-30). In addition or as an 
alternative, these resources may facilitate the development and implementation of a PDSP for a 
particular software project of the organization. (Page 11, Line 30, through Page 12, Line 2). 

FIGURE 6 illustrates an example method for facilitating software engineering and 
management in connection with a software development project according to a process that is 
compliant with a qualitatively measurable standard. (Page 15, Lines 4-6). The method begins at 
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step 100 where a user at a client system 14 accesses server system 12. (Page 15, Lines 6-7). At 
step 102, the user selects a particular resource set 18 in resource database 16. (Page 15, Lines 7- 
8). In particular embodiments, server system may provide a menu of resource sets 1 8 to the user 
to enable the user to make this selection. (Page 15, Lines 8-10). At step 104, server system 12 
provides user with links 32 to particular resources in resource set 18 selected by the user. (Page 
15, Lines 10-11). At step 106, the user selects a particular link 32 to a particular resource in 
resource set 18. (Page 15, Lines 11-13). At step 108, server system 12 accesses the particular 
resource and communicates the particular resource to the user. (Page 15, Lines 13-14). At step 
110, the user uses the particular resource in connection with a software project to facilitate the 
software project's compliance with one or more MLs associated with resource set 18, at which 
point the method ends. (Page 15, Lines 14-16). One or more steps in the method illustrated in 
FIGURE 6 may be repeated over the course of the software project to facilitate compliance with 
those MLs with respect to certain aspects of the software project. (Page 15, Lines 17-19). 



For the convenience of the Board, Appellant provides the following mappings of the 
independent claims here on appeal. Appellant does not necessarily identify all portions of the 
Specification and Drawings relevant to the recited elements of the claims. Appellant provides 
the following mapping not to limit the scope of the claims, but to help the Board make a decision 
on this Appeal: 



Independent Claim 1 recites: 

A system facilitating software engineering and management in connection 
with a software development project according to a process that is compliant with 
a qualitatively measurable standard, comprising: 

a server system operable to communicate with a plurality of client 
systems; (e.g.: Figure 1; Page 7, Line 18, through Page 8, Line 5) 

a database associated with the server system and containing resources 
accessible to the client systems using the server system in connection with one or 
more software development projects, the resources comprising at least: (e.g.: 
Figure 1; Page 8, Lines 6-19) 

first resources specifying a plurality of tasks to be performed 
within the process and specifying for each task one or more of: (e.g.: Figure 1; 
Page 7, Line 18, through Page 10, Line 2) 

a description of the task; (e.g.: Page 11, Line 19, through 
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Page 12, Line 2; Page 12, Line 25, through Page 14, Line 4) 

a description of how the task relates to the standard; (e.g.: 
Page 11, Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 14, 
Line 4) 

one or more activities to be performed for the task; (e.g.: 
Page 11, Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 14, 
Line 4) 

which personnel should perform the activities for the task; 
(e.g.: Page 11, Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 
14, Line 4) 

one or more deliverables to be generated for the task; (e.g.: 
Page 11, Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 14, 
Line 4) 

one or more expected artifacts according to which the 
process will be measured against the standard; and (e.g.: Page 11, Line 19, 
through Page 12, Line 2; Page 12, Line 25, through Page 14, Line 4) 

an expected time to complete the task; and (e.g.: Page 11, 
Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 14, Line 4) 

second resources comprising one or more templates, each template 
operable to be customized in generating one or more deliverables for one or more 
tasks; (Figure 5; Page 8, Line 20, through Page 9, Line 12; Page 11, Line 19, 
through Page 12, Line 2; Page 14, Line 27, through Page 15, Line 3) 

the server system operable to, at one or more times during a software 
development project: (Figure 6; Page 15, Lines 4-19) 

receive from a user associated with a client system a request for 
one or more resources; (Figure 6; Page 15, Lines 4-19) 

retrieve the requested resources from the database; and (Figure 6; 
Page 15, Lines 4-19) 

provide the requested resources to the user in connection with the 
software development project. (Figure 6; Page 15, Lines 4-19) 



Independent Claim 7 recites: 

A method facilitating software engineering and management in connection 
with a software development project according to a process that is compliant with 
a qualitatively measurable standard, comprising: 

providing a plurality of client systems with access to a database associated 
with a server system in connection with one or more software development 
projects, the database containing resources comprising at least: (e.g.: Figure 1; 
Page 7, Line 18, through Page 8, Line 19) 

first resources specifying a plurality of tasks to be performed 
within the process and specifying for each task one or more of: (e.g.: Figure 1; 
Page 7, Line 18, through Page 10, Line 2) 

a description of the task; (e.g.: Page 11, Line 19, through 
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Page 12, Line 2; Page 12, Line 25, through Page 14, Line 4) 

a description of how the task relates to the standard; (e.g.: 
Page 11, Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 14, 
Line 4) 

one or more activities to be performed for the task; (e.g.: 
Page 11, Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 14, 
Line 4) 

which personnel should perform the activities for the task; 
(e.g.: Page 11, Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 
14, Line 4) 

one or more deliverables to be generated for the task; (e.g.: 
Page 11, Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 14, 
Line 4) 

one or more expected artifacts according to which the 
process will be measured against the standard; and (e.g.: Page 11, Line 19, 
through Page 12, Line 2; Page 12, Line 25, through Page 14, Line 4) 

an expected time to complete the task; and (e.g.: Page 11, 
Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 14, Line 4) 

second resources comprising one or more templates, each template 
operable to be customized in generating one or more deliverables for one or more 
tasks; (Figure 5; Page 8, Line 20, through Page 9, Line 12; Page 11, Line 19, 
through Page 12, Line 2; Page 14, Line 27, through Page 15, Line 3) 

at one or more times during a software development project: (Figure 6; 
Page 15, Lines 4-19) 

receiving from a user associated with a client system a request for 
one or more resources; (Figure 6; Page 15, Lines 4-19) 

retrieving the requested resources from the database; and (Figure 
6; Page 15, Lines 4-19) 

providing the requested resources to the user in connection with 
the software development project. (Figure 6; Page 15, Lines 4-19) 



Independent Claim 13 recites: 

Software facilitating software engineering and management in connection 
with a software development project according to a process that is compliant with 
a qualitatively measurable standard, the software being embodied in computer 
readable media and when executed operable to: 

provide a plurality of client systems with access to a database associated 
with a server system in connection with one or more software development 
projects, the database containing resources comprising at least: (e.g.: Figure 1; 
Page 7, Line 1 8, through Page 8, Line 1 9) 

first resources specifying a plurality of tasks to be performed 
within the process and specifying for each task one or more of: (e.g.: Figure 1; 
Page 7, Line 1 8, through Page 1 0, Line 2) 
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a description of the task; (e.g.: Page 11, Line 19, through 
Page 12, Line 2; Page 12, Line 25, through Page 14, Line 4) 

a description of how the task relates to the standard; (e.g.: 
Page 11, Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 14, 
Line 4) 

one or more activities to be performed for the task; (e.g.: 
Page 11, Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 14, 
Line 4) 

which personnel should perform the activities for the task; 
(e.g.: Page 11, Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 
14, Line 4) 

one or more deliverables to be generated for the task; (e.g.: 
Page 11, Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 14, 
Line 4) 

one or more expected artifacts according to which the 
process will be measured against the standard; and (e.g.: Page 11, Line 19, 
through Page 12, Line 2; Page 12, Line 25, through Page 14, Line 4) 

an expected time to complete the task; and (e.g.: Page 11, 
Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 14, Line 4) 

second resources comprising one or more templates, each template 
operable to be customized in generating one or more deliverables for one or more 
tasks; (Figure 5; Page 8, Line 20, through Page 9, Line 12; Page 11, Line 19, 
through Page 12, Line 2; Page 14, Line 27, through Page 15, Line 3) 

at one or more times during a software development project: (Figure 6; 
Page 15, Lines 4-19) 

receive from a user associated with a client system a request for 
one or more resources; (Figure 6; Page 15, Lines 4-19) 

retrieve the requested resources from the database; and (Figure 6; 
Page 15, Lines 4-19) 

provide the requested resources to the user in connection with the 
software development project. (Figure 6; Page 15, Lines 4-19) 



Independent Claim 19 recites: 

A system facilitating software engineering and management in connection 
with a software development project according to a process that is compliant with 
a qualitatively measurable standard, comprising: 

means for providing a plurality of client systems with access to a database 
associated with a server system in connection with one or more software 
development projects, the database containing resources comprising at least: (e.g.: 
Resource Database 16; Figure 1; Page 7, Line 18, through Page 8, Line 19) 

first resources specifying a plurality of tasks to be performed 
within the process and specifying for each task one or more of: (e.g.: Figure 1; 
Page 7, Line 1 8, through Page 1 0, Line 2) 
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a description of the task; (e.g.: Page 11, Line 19, through 
Page 12, Line 2; Page 12, Line 25, through Page 14, Line 4) 

a description of how the task relates to the standard; (e.g.: 
Page 11, Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 14, 
Line 4) 

one or more activities to be performed for the task; (e.g.: 
Page 11, Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 14, 
Line 4) 

which personnel should perform the activities for the task; 
(e.g.: Page 11, Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 
14, Line 4) 

one or more deliverables to be generated for the task; (e.g.: 
Page 11, Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 14, 
Line 4) 

one or more expected artifacts according to which the 
process will be measured against the standard; and (e.g.: Page 11, Line 19, 
through Page 12, Line 2; Page 12, Line 25, through Page 14, Line 4) 

an expected time to complete the task; and (e.g.: Page 11, 
Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 14, Line 4) 

second resources comprising one or more templates, each template 
operable to be customized in generating one or more deliverables for one or more 
tasks; (Figure 5; Page 8, Line 20, through Page 9, Line 12; Page 11, Line 19, 
through Page 12, Line 2; Page 14, Line 27, through Page 15, Line 3) 

means for, at one or more times during a software development project: 
(Server System 12; Figure 6; Page 15, Lines 4-19) 

receiving from a user associated with a client system a request for 
one or more resources; (Figure 6; Page 15, Lines 4-19) 

retrieving the requested resources from the database; and (Figure 
6; Page 15, Lines 4-19) 

providing the requested resources to the user in connection with 
the software development project. (Figure 6; Page 15, Lines 4-19) 



Independent Claim 20 recites: 

A system facilitating software engineering and management in connection 
with a software development project according to a process that is compliant with 
the Software Engineering Institute's Software Capability Maturity Model 
(SEI/SW-CMM), the SEI/SW-CMM comprising one or more maturity levels, 
each maturity level comprising a plurality of key practice areas, each key practice 
area comprising a plurality of goals, each goal comprising a plurality of key 
practices, the system comprising: (e.g.: Figure 2; Page 8, Line 20, through Page 9, 
Line 12) 

a server system operable to communicate with a plurality of client 
systems; (e.g.: Figure 1; Page 7, Line 18, through Page 8, Line 5) 
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a database associated with the server system and containing resources 
accessible to the client systems using the server system in connection with one or 
more software development projects, the resources comprising at least: (e.g.: 
Figure 1; Page 8, Lines 6-19) 

first resources specifying a plurality of tasks to be performed 
within the process and specifying for each task one or more of: (e.g.: Figure 1; 
Page 7, Line 1 8, through Page 1 0, Line 2) 

a description of the task; (e.g.: Page 11, Line 19, through 
Page 12, Line 2; Page 12, Line 25, through Page 14, Line 4) 

an identification of one or more SEI/SW-CMM maturity 
levels, key practice areas, goals, and key practices to which the task relates; (e.g.: 
Page 8, Line 20, through Page 9, Line 12; Page 11, Line 19, through Page 12, 
Line 2; Page 12, Line 25, through Page 14, Line 4) 

one or more activities to be performed for the task; (e.g.: 
Page 11, Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 14, 
Line 4) 

which personnel should perform the activities for the task; 
(e.g.: Page 1 1, Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 
14, Line 4) 

one or more deliverables to be generated for the task; (e.g.: 
Page 11, Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 14, 
Line 4) 

one or more expected artifacts according to which the 
process will be measured against the SEI/SW-CMM; and (e.g.: Page 11, Line 19, 
through Page 12, Line 2; Page 12, Line 25, through Page 14, Line 4) 

an expected time to complete the task; and (e.g.: Page 11, 
Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 14, Line 4) 

second resources comprising one or more templates, each template 
operable to be customized in generating one or more deliverables for one or more 
tasks, each template comprising one of: (Figure 5; Page 8, Line 20, through Page 
9, Line 12; Page 11, Line 19, through Page 12, Line 2; Page 14, Line 27, through 
Page 15, Line 3) 

a standard template generic to a plurality of software 
development projects within an enterprise; and (Figure 5; Page 8, Line 20, 
through Page 9, Line 12; Page 11, Line 19, through Page 12, Line 2; Page 14, 
Line 27, through Page 15, Line 3) 

at least a portion of a deliverable generated in connection 
with a previous software development project; (Figure 5; Page 8, Line 20, through 
Page 9, Line 12; Page 11, Line 19, through Page 12, Line 2; Page 14, Line 27, 
through Page 15, Line 3) 

the server system operable to, at one or more times during a software 
development project: (Figure 6; Page 15, Lines 4-19) 

receive from a user associated with a client system a request for 
one or more resources; (Figure 6; Page 15, Lines 4-19) 
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retrieve the requested resources from the database; and (Figure 6; 
Page 15, Lines 4-19) 

provide the requested resources to the user in connection with the 
software development project; (Figure 6; Page 15, Lines 4-19) 

the server system further operable to, at one or more times during a 
software development project: (Figure 1; Page 7, Line 18, through Page 8, Line 5) 

receive a deliverable generated in connection with the software 
development project; (Figure 1; Page 7, Line 18, through Page 8, Line 5) 

store at least a portion of the deliverable in the database; 
and(Figure 1; Page 7, Line 18, through Page 8, Line 5) 

make the stored portion of the deliverable accessible to the client 
systems for use, with or without customization, in connection with subsequent 
software development projects. (Figure 1; Page 7, Line 18, through Page 8, Line 



DALO 1:99591 1.1 



ATTORNEY DOCKET: 
068215.0120 



22 



PATENT APPLICATION 
10/696,817 



Grounds of Rejection for Review on Appeal 

Appellant requests the Board to review the Examiner's final rejection of Claims 1-20 
under 35 U.S.C. §102(e) as being anticipated by U.S. Patent Application Publication No. 
2006/0235732 by Miller et al. ("Miller"). The attached Evidence Appendix includes a copy of 
Miller. 
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Argument 

For at least the following reasons, the Examiner's final rejection of Claims 1-20 is 
improper and the Board should reverse the Examiner's rejection. 



Independent Claims 1, 7, 13, and 19-20 are Allowable Over Miller 

The Examiner rejects independent Claims 1, 7, 13 and 19-20 under 35 U.S.C. § 102(e) as 
being anticipated by U.S. Patent Application Publication No. 2006/0235732 by Miller et al. 
{"Miller"). Miller merely discloses a database containing information on an organization and its 
suppliers and a multiple repository system containing stored templates that users can access to 
compose documents through the stored templates. (Figures 11A-11B and 14; Paragraph 0280 
and 0310-0311). 

In contrast, independent Claim 1 of this Application recites: 

A system facilitating software engineering and management in connection 
with a software development project according to a process that is compliant with 
a qualitatively measurable standard, comprising: 

a server system operable to communicate with a plurality of client 
systems; 

a database associated with the server system and containing resources 
accessible to the client systems using the server system in connection with one or 
more software development projects, the resources comprising at least: 

first resources specifying a plurality of tasks to be performed 
within the process and specifying for each task one or more of: 
a description of the task; 

a description of how the task relates to the standard; 

one or more activities to be performed for the task; 

which personnel should perform the activities for the task; 

one or more deliverables to be generated for the task; 

one or more expected artifacts according to which the 
process will be measured against the standard; and 

an expected time to complete the task; and 
second resources comprising one or more templates, each template 
operable to be customized in generating one or more deliverables for one or more 
tasks; 

the server system operable to, at one or more times during a software 
development project: 
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receive from a user associated with a client system a request for 

one or more resources; 

retrieve the requested resources from the database; and 

provide the requested resources to the user in connection with the 

software development project. 

Independent Claims 7, 13, and 19-20 recite similar limitations. 

To reject independent Claim 1, the Examiner asserts either the database containing 
information on an organization and its suppliers or the multiple repository system in Miller can 
properly be considered a database associated with the server system and containing resources 
accessible to the client systems using the server system in connection with one or more 
software development projects, as independent Claim 1 recites. Appellant disagrees with the 
Examiner. 

Even assuming for the sake or argument the database in Miller containing information on 
an organization and its suppliers or the multiple repository system in Miller could properly be 
considered a database associated with the server system and containing resources accessible to 
the client systems using the server system in connection with one or more software 
development projects, Miller would still fail to disclose, teach, or suggest that the database in 
Miller, the multiple repository system in Miller, or a combination of the two contains, as 
independent Claim 1 specifically recites, first resources specifying a plurality of tasks to be 
performed within the process and specifying for each task one or more of: 

• a description of the task; 

. a description of how the task relates to the standard; 

. one or more activities to be performed for the task; 

. which personnel should perform the activities for the task; 

• one or more deliverables to be generated for the task; 

. one or more expected artifacts according to which the process will be measured 
against the standard; and 

• an expected time to complete the task. 
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The database in Miller merely contains information on an organization and its suppliers. 
Moreover, the multiple repository system in Miller merely contains stored templates users can 
access to compose documents through the stored templates. (Figures 11A-11-B and 14; 
Paragraph 0280 and 0310-031 1). Nowhere does Miller disclose, teach, or suggest that either or 
both contain each and every one of the first resources that independent Claim 1 specifically 
recites. 

In the Office Action sent 13 September 2007, the Examiner identifies various steps of a 
Software Engineering Process Group (SEPG) project execution process in Miller and asserts 
these steps are contents of the multiple repository system in Miller that can properly be 
considered/*/^ resources. Appellant again disagrees with the Examiner. Even assuming for the 
sake of argument these steps in Miller could properly be considered as specifying for each 
task — which is not at all clear — Miller would still fail to disclose, teach, or suggest that the 
multiple repository system in Miller contains any of those steps. 

In the Advisory Action sent 13 December 2007, the Examiner asserts the multiple 
repository accelerated process improvement framework (APIF) system in Miller can properly be 
considered a database associated with the server system and containing resources accessible to 
the client systems using the server system in connection with one or more software 
development projects. Appellant again disagrees with the Examiner. As the Examiner points 
out, the APIF system in Miller distributes documents needed for a CMM method, including 
instructions for implementing the CMM method and documentation to evidence actions taken in 
the CMM method. Even so, Miller still fails to disclose, teach, or suggest that these instructions 
and documentation can properly be considered each and every one of the first resources that 
independent Claim 1 specifically recites. 

"To anticipate, every element and limitation of the claimed invention must be found in a 
single prior art reference, arranged as in the claim." Brown v. 3M, 265 F.3d 1349, 1351 (Fed. 
Cir. 2001). "A claim is anticipated only if each and every element as set forth in the claim is 
found, either expressly or inherently described, in a single prior art reference." Verdegaal Bros. 
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v. Union Oil Co. of California, 814 F.2d 628, 631, 2 U.S.P.Q.2d 1051, 1053 (Fed. Cir. 1987); 
M.P.E.P. ch. 2131 (Rev. 3, Aug. 2005) (quoting Verdegaal, 814 F.2d at 631). Moreover, "[t]he 
identical invention must be shown in as complete detail as is contained in the patent claim." 
Richardson v. Suzuki Motor Co., 868 F.2d 1226, 1236, 9 U.S.P.Q.2d 1913, 1920 (Fed. Cir. 

1989) ; M.P.E.P. ch. 2131 (Rev. 3, Aug. 2005) (quoting Richardson, 868 F.2d at 1236). 
Furthermore, "[t]he elements must be arranged as required by the claim." M.P.E.P. ch. 2131 
(Rev. 3, Aug. 2005) (citing In re Bond, 910 F.2d 831, 832, 15 U.S.P.Q.2d 1566, 1567 (Fed. Cir. 

1990) ). As shown above, Miller fails to disclose, either expressly or inherently, each and every 
limitation of independent Claim 1 . Therefore, Miller does not anticipate independent Claim 1 
under governing Federal Circuit case law and the M.P.E.P. 

For at least the reasons above, independent Claims 1, 7, 13, and 19-20 are allowable over 
the cited references. Accordingly, the Board should reverse the final rejection of independent 
Claims 1, 7, 13, and 19-20 and all their dependent claims and instruct the Examiner to issue a 
notice of allowance of the same. 
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Conclusion 



Appellant has demonstrated that the pending claims are clearly allowable. Appellant 
respectfully requests the Board of Patent Appeals and Interferences to reverse the Examiner's 
final rejection of the pending claims and instruct the Examiner to issue a notice of allowance of 
the same. 

Please charge $510.00 for this Appeal Brief and $460.00 for a two-month extension of 
time to Deposit Account No. 02-0384 of BAKER BOTTS L.L.P. The Commissioner is 
authorized to charge any fee and credit any overpayment to Deposit Account No. 02-0384 of 



BAKER BOTTS L.L.P. 



Respectfully submitted, 

BAKER BOTTS L.L.P. 
Attorneys for Appellant 




Travis W. Thomas 
Reg. No. 48,667 



Date: 17 April 2008 



Correspondence Address: 
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Claims Appendix 

1. (Original) A system facilitating software engineering and management in 
connection with a software development project according to a process that is compliant with a 
qualitatively measurable standard, comprising: 

a server system operable to communicate with a plurality of client systems; 

a database associated with the server system and containing resources accessible to the 
client systems using the server system in connection with one or more software development 
projects, the resources comprising at least: 

first resources specifying a plurality of tasks to be performed within the process 
and specifying for each task one or more of: 

a description of the task; 

a description of how the task relates to the standard; 

one or more activities to be performed for the task; 

which personnel should perform the activities for the task; 

one or more deliverables to be generated for the task; 

one or more expected artifacts according to which the process will be 
measured against the standard; and 

an expected time to complete the task; and 
second resources comprising one or more templates, each template operable to be 
customized in generating one or more deliverables for one or more tasks; 

the server system operable to, at one or more times during a software development 

project: 

receive from a user associated with a client system a request for one or more 

resources; 

retrieve the requested resources from the database; and 

provide the requested resources to the user in connection with the software 
development project. 
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| 

| 2. (Original) The system of Claim 1, wherein the standard comprises one or 

more maturity levels, each maturity level comprising a plurality of key practice areas, each key 
practice area comprising a plurality of goals, each goal comprising a plurality of key practices. 

3. (Original) The system of Claim 2, wherein the standard comprises the 
Software Engineering Institute's Software Capability Maturity Model (SEI/SW-CMM). 

4. (Original) The system of Claim 2, wherein the description of how the task 
relates to the standard comprises an identification of one or more maturity levels, key practice 
areas, goals, and key practices to which the task relates. 

5. (Original) The system of Claim 1 , wherein each template comprises one of: 

a standard template generic to a plurality of software development projects within an 
enterprise; and 

a deliverable generated in connection with a previous software development project. 

6. (Original) The system of Claim 1, wherein the server system is further 
operable to, at one or more times during a software development project: 

receive a deliverable generated in connection with the software development project; 
store at least a portion of the deliverable in the database; and 

make the stored portion of the deliverable accessible to the client systems for use, with or 
without customization, in connection with subsequent software development projects. 
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7. (Original) A method facilitating software engineering and management in 
connection with a software development project according to a process that is compliant with a 
qualitatively measurable standard, comprising: 

providing a plurality of client systems with access to a database associated with a server 
system in connection with one or more software development projects, the database containing 
resources comprising at least: 

first resources specifying a plurality of tasks to be performed within the process 
and specifying for each task one or more of: 

a description of the task; 

a description of how the task relates to the standard; 
one or more activities to be performed for the task; 
which personnel should perform the activities for the task; 
one or more deliverables to be generated for the task; 
one or more expected artifacts according to which the process will be 
measured against the standard; and 

an expected time to complete the task; and 
second resources comprising one or more templates, each template operable to be 
customized in generating one or more deliverables for one or more tasks; 
at one or more times during a software development project: 

receiving from a user associated with a client system a request for one or more 

resources; 

retrieving the requested resources from the database; and 

providing the requested resources to the user in connection with the software 
development project. 

8. (Original) The method of Claim 7, wherein the standard comprises one or 
more maturity levels, each maturity level comprising a plurality of key practice areas, each key 
practice area comprising a plurality of goals, each goal comprising a plurality of key practices. 
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9. (Original) The method of Claim 8, wherein the standard comprises the 
Software Engineering Institute's Software Capability Maturity Model (SEI/SW-CMM). 

10. (Original) The method of Claim 8, wherein the description of how the task 
relates to the standard comprises an identification of one or more maturity levels, key practice 
areas, goals, and key practices to which the task relates. 

1 1 . (Original) The method of Claim 7, wherein each template comprises one of: 

a standard template generic to a plurality of software development projects within an 
enterprise; and 

a deliverable generated in connection with a previous software development project. 

12. (Original) The method of Claim 7, further comprising, at one or more times 
during a software development project: 

receiving a deliverable generated in connection with the software development project; 
storing at least a portion of the deliverable in the database; and 

making the stored portion of the deliverable accessible to the client systems for use, with 
or without customization, in connection with subsequent software development projects. 
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13. (Original) Software facilitating software engineering and management in 
connection with a software development project according to a process that is compliant with a 
qualitatively measurable standard, the software being embodied in computer readable media and 
when executed operable to: 

provide a plurality of client systems with access to a database associated with a server 
system in connection with one or more software development projects, the database containing 
resources comprising at least: 

first resources specifying a plurality of tasks to be performed within the process 
and specifying for each task one or more of: 

a description of the task; 

a description of how the task relates to the standard; 
one or more activities to be performed for the task; 
which personnel should perform the activities for the task; 
one or more deliverables to be generated for the task; 
one or more expected artifacts according to which the process will be 
measured against the standard; and 

an expected time to complete the task; and 
second resources comprising one or more templates, each template operable to be 
customized in generating one or more deliverables for one or more tasks; 
at one or more times during a software development project: 

receive from a user associated with a client system a request for one or more 

resources; 

retrieve the requested resources from the database; and 

provide the requested resources to the user in connection with the software 
development project. 

14. (Original) The software of Claim 13, wherein the standard comprises one or 
more maturity levels, each maturity level comprising a plurality of key practice areas, each key 
practice area comprising a plurality of goals, each goal comprising a plurality of key practices. 
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15. (Original) The software of Claim 14, wherein the standard comprises the 
Software Engineering Institute's Software Capability Maturity Model (SEI/SW-CMM). 

16. (Original) The software of Claim 14, wherein the description of how the task 
relates to the standard comprises an identification of one or more maturity levels, key practice 
areas, goals, and key practices to which the task relates. 

17. (Original) The software of Claim 13, wherein each template comprises one 

of: 

a standard template generic to a plurality of software development projects within an 
enterprise; and 

a deliverable generated in connection with a previous software development project. 

18. (Original) The software of Claim 13, further operable to, at one or more times 
during a software development project: 

receive a deliverable generated in connection with the software development project; 
store at least a portion of the deliverable in the database; and 

make the stored portion of the deliverable accessible to the client systems for use, with or 
without customization, in connection with subsequent software development projects. 
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19. (Original) A system facilitating software engineering and management in 
connection with a software development project according to a process that is compliant with a 
qualitatively measurable standard, comprising: 

means for providing a plurality of client systems with access to a database associated 
with a server system in connection with one or more software development projects, the database 
containing resources comprising at least: 

first resources specifying a plurality of tasks to be performed within the process 
and specifying for each task one or more of: 

a description of the task; 

a description of how the task relates to the standard; 
one or more activities to be performed for the task; 
which personnel should perform the activities for the task; 
one or more deliverables to be generated for the task; 
one or more expected artifacts according to which the process will be 
measured against the standard; and 

an expected time to complete the task; and 
second resources comprising one or more templates, each template operable to be 
customized in generating one or more deliverables for one or more tasks; 

means for, at one or more times during a software development project: 

receiving from a user associated with a client system a request for one or more 

resources; 

retrieving the requested resources from the database; and 

providing the requested resources to the user in connection with the software 
development project. 
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20. (Original) A system facilitating software engineering and management in 
connection with a software development project according to a process that is compliant with the 
Software Engineering Institute's Software Capability Maturity Model (SEI/SW-CMM), the 
SEI/SW-CMM comprising one or more maturity levels, each maturity level comprising a 
plurality of key practice areas, each key practice area comprising a plurality of goals, each goal 
comprising a plurality of key practices, the system comprising: 

a server system operable to communicate with a plurality of client systems; 

a database associated with the server system and containing resources accessible to the 
client systems using the server system in connection with one or more software development 
projects, the resources comprising at least: 

first resources specifying a plurality of tasks to be performed within the process 
and specifying for each task one or more of: 

a description of the task; 

an identification of one or more SEI/SW-CMM maturity levels, key 
practice areas, goals, and key practices to which the task relates; 

one or more activities to be performed for the task; 

which personnel should perform the activities for the task; 

one or more deliverables to be generated for the task; 

one or more expected artifacts according to which the process will be 
measured against the SEI/SW-CMM; and 

an expected time to complete the task; and 
second resources comprising one or more templates, each template operable to be 
customized in generating one or more deliverables for one or more tasks, each template 
comprising one of: 

a standard template generic to a plurality of software development projects 
within an enterprise; and 

at least a portion of a deliverable generated in connection with a previous 
software development project; 

the server system operable to, at one or more times during a software development 

project: 
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receive from a user associated with a client system a request for one or more 

resources; 

retrieve the requested resources from the database; and 

provide the requested resources to the user in connection with the software 
development project. 

the server system further operable to, at one or more times during a software 
development project: 

receive a deliverable generated in connection with the software development 

project; 

store at least a portion of the deliverable in the database; and 
make the stored portion of the deliverable accessible to the client systems for use, 
with or without customization, in connection with subsequent software development projects. 
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(57) ABSTRACT 

The present invention relates to a method and related system 
for assisting and expediting an organization production of a 
more mature product. The method and system may include 
implementation of processes using a combination of both 
electronic hardware and software and implementation 
locally or over a network such as an intranet or the Internet. 
In another embodiment, the method may be implemented 
using a document management system to administer files 
related to the steps in the method. These files may assist a 
user in the creation of required documentation. A document 
management tool may be integrated with the document 
management system to associate documentation with steps 
in the method. A navigator tool may be employed to create 
a graphical display of the steps in the method using data 
contained in the files. Another embodiment of the present 
invention uses WebDAV-based communication to coordi- 
nate access to multiple document repositories. 
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ACCELERATED PROCESS IMPROVEMENT 
FRAMEWORK 

RELATED APPLICATIONS 

[0001] This application is a continuation-in-part of U.S. 
application Ser. No. 10/005,759, filed on Dec. 7, 2001, the 
contents of which are hereby incorporated by reference in 
their entirety. The application further claims priority from 
U.S. Provisional Application No. 60/399,459 filed on Jul. 
31, 2002, the contents of which are also incorporated by 
reference in their entirety. 

FIELD OF THE INVENTION 

[0002] The present invention relates to a method for 
assisting and expediting an organization's progression 
through the levels of the Capability Maturity Model (CMM). 
Specifically, the present invention relates to a method and 
related system for arranging and administering an organi- 
zation's infrastructure and a project of interest so that the 
organization and the product may be more mature, as 
measured by the CMM. 

BACKGROUND OF THE INVENTION 

[0003] The Capability Maturity Model® (CMM®) may 
refer specifically to the Capability Mauirity Model for 
Software (SW-CMM) or, more generally, to a number of 
other process improvement models developed by the Soft- 
ware Engineering Institute (SEI) and registered to Carnegie 
Mellon University. The SW-CMM was the first model 
developed by the SEI, and it originally evolved from the 
need for the United States Department of Defense to have 
another measure besides "lowest bidder" in determining 
who should win project bids. Specifically, the Department of 
Defense desired a method to better compare and distinguish 
well designed and shoddy, defective products. The two 
major usages of the SW-CMM are: (1) as a model for 
Software Process Improvement (SPI) and (2) as a measure 
of the capability to produce quality systems. Specifically, the 
CMM may help a purchaser differentiate properly working 
product from an incomplete, nonfunctioning, poorly 
designed product by providing information on a producing 
organization and its production and development proce- 
dures. 

[0004] The CMM is an example of a model-based 
improvement approach that focuses on creation process 
quality. The rationale for this focus is that, unlike hardware, 
manufacturing software is essentially error free (i.e., the 
production of the disks containing the program), but the 
quality defects (i.e., bugs) are produced during the concept 
and development process. Therefore, waiting to identify 
defects after creation of the product is generally difficult and 
costly. The CMM may be used as a guideline for prioritizing 
limited resources on the most important, foundational 
improvements. In the SW-CMM, Key Process .Areas (KPAs) 
define "building blocks" based on industry best practices. 
The ultimate goal is to establish "continual improvement" of 
the software engineering process and the resulting products, 
kaizen (Statistical Process Control), which is common in 
nonsoftware engineering disciplines. The CMM is described 
more fully in Mark C. Paulk, The Capability Maturity 
Model: Guidelines for Improving the Software Process {The 
SEI Series) (Addison-Wesley Pub Co.) (1995). 



[0005] The Capability Maturity Model Integration SM 
(CMM SM ) was developed to integrate the SW-CMM and 
various other existing models into a common model. The 
developers of the CMMI are seeking to establish common 
terminology between the models, as well as identifying 
commonality and variability. The SEI is expected to release 
Version 1.1 of CMMI in the near future. 
[0006] The SW-CMM model defines five capability levels 
and identifies Key Process Areas (KPAs). The CMMI model 
replaces the KPAs with Process Areas (PAs). The lower 
levels of the CMMI and the related PAs focus mainly on 
management processes and industry minimal standards. 
Higher CMMI levels and the related PAs generally focus 
more on organizational and technical processes. The higher 
levels and their PAs also strive for "industry-best" practice. 
[0007] While the entire scope of the CMMI is vast and 
generally outside the range of this document, the various 
levels of the CMMI are now quickly described. At level 0 or 
"Incomplete", a project has not yet started. Upon initiation 
and existence of the project, the project is at level 1. At 
"Initial" or level 1, the product conditions are ad hoc, 
chaotic, and high-risk. At "Repeatable" or level 2, the 
project may repeatedly perform some functions with diffi- 
culty. Relevant PAs to level 2 are Requirements Manage- 
ment (RM); Project Planning (PP); Project Monitoring and 
Control (PMC or PC); Supplier Agreement Management 
(SAM or SM); Process and Product Quality Assurance 
(PPQA or QA); Configuration Management (CM); and 
Measurement and Analysis (MA). 

[0008] At "Organizationally Defined" or level 3, the rel- 
evant PAs include Requirements Development (RD): Tech- 
nical Solution (TS); Product Integration (PI); Validation 
(Va); Verification (Ve); Organization Process Focus (OPF or 
PF); Organizational Process Definition (OPD or PD); Orga- 
nizational Training (OT); Integrated Project Management 
(1PM or IM); Risk Management (RSKM or Rk); Decision 
Analysis and Resolution (DAR or DA); Organizational 
Environment for Integration (Ql); and Integrated Teaming 
(IT). 

[0009] At "Quantitatively Managed" or level 4, the rel- 
evant PAs are Quantitative Process Management (QPM or 
QM) and Organizational Process Performance (OPP or OP). 
QPM relates to the informed and correct use of rigorous 
statistical techniques such as statistical process control 
(SPC), with the focus on removing specific or attributable 
causes of variance, and OPP relates to the use of statistical 
techniques to measure process efficiency. The fifth and 
highest level, "Optimizing", is basically equivalent to bot- 
tom-up process improvement or continuous improvement. 
In CMMI, the level 5 PAs are Organizational Innovation and 
Deployment (OID or ID) and Causal Analysis and Resolu- 
tion (CAR or CA). 

[0010] The Capability Maturity Model for Software (SW- 
CMM) was the first, but not the only, model for improve- 
ment of software development. Some other models devel- 
oped by the SEI include: Integrated Product Development 
CMM (IPD-CMM), which was renamed and incorporated 
into CMMI Integrated Product and Process Development 
(IPPD); People CMM (P-CMM) for Training, Career Devel- 
opment, and Human Resource-related issues; Personal Soft- 
ware Process SM (PSP SM ); Software Acquisition CMM® 
(SA-CMM); and Systems Engineering CMM® (SE-CMM), 



US 2006/0235732 Al 



2 



Oct. 19, 2006 



which is being incorporated into CMMI for Systems Engi- 
neering/Software Engineering. Similarly, FAA-iCMM (a 
model similar to CMMI and incorporating elements of 
SW-CMM, SE-CMM, and SA-CMM) was developed by the 
Federal Aviation Administration. 

[0011] Achieving higher levels of CMM maturity is a 
desirable goal in itself because it generally implies that an 
organization is producing a superior product and services 
since the higher levels of the CMM generally require the 
existence of infrastructure and procedures leading to better 
tested and developed software and other products. As sug- 
gested above, organizations also have secondary financial 
incentives to achieve higher CMM levels, because custom- 
ers, such as the United States Department of Defense, are 
increasingly requiring software suppliers to have a suffi- 
ciently high CMM level (e.g., at least level 2) before being 
awarded a contract. 

[0012] A threshold problem for many organizations is that 
the requirements for the different maturity levels are rela- 
tively complex to understand and implement. It is, therefore, 
a goal of the present invention to provide a method allowing 
businesses to achieve higher CMM levels without having to 
understand the complicated requirements of each level. 
[0013] Furthermore, the process of achieving higher 
CMM levels of increased maturity is typically a difficult, 
expensive, and time-intensive process. While some of the 
costs arc unavoidable, many of the difficulties of achieving 
higher CMM levels occur because the requirements for the 
levels do not fit well within the general operations and 
structure of most organizations. Drastically changing an 
organization's structure and operations is generally a com- 
plex and difficult process. Therefore, another goal of the 
present invention is to provide a method that simplifies and 
potentially accelerates the process of modifying an organi- 
zation's operations and structure to meet the requirements of 
the higher CMM levels. 

[0014] Similarly, many organizations also have difficulty 
implementing changes to achieve higher CMM or CMMf 
levels because the organization use of these maturity models 
as merely checklists of criteria. The maturity models, while 
serving as a measure to assess organizations, offer little 
guidance to organizations on implementation of the speci- 
fied criteria. The random implementation of the items on a 
maturity model checklist results in increased time and cost 
for maturation in comparison to carrying out systemic 
changes that may concurrently satisfy multiple checklist 
items and assist the organization in achieving several check- 
list items. Furthermore, a piecemeal implementation of the 
CMM worsens the above-described problems of complexity 
and cost. It is, therefore, another goal of the present inven- 
tion to provide a method by which organizations may 
implement systemic changes to achieve higher levels of 
CMM maturity. 

SUMMARY OF THE INVENTION 

[0015] In response to these and other needs, the present 
invention provides a method and related system for assisting 
and expediting an organization's transformation toward 
higher levels of the Capability Maturity Model (CMM) or 
other derivative maturity models. In particular, the present 
invention provides a method for producing a more mature 
product. A preferred embodiment of the method comprises 



the managing an organization developing the product, 
whereby the organizational management comprises manag- 
ing personnel of the organization and implementing a prod- 
uct improvement process. The method may further comprise 
managing a project for developing the product and manag- 
ing the delivery of the product. Furthermore, actions under- 
taken during the organizational management affects imple- 
mentation of the project and delivery managements, and the 
actions undertaken during the project and delivery manage- 
ments likewise affect implementation of the organizational 
management. 

[001 6] In another embodiment, this method may be imple- 
mented using a combination of both electronic hardware and 
software and may be implemented locally or over a network 
such as an intranet or the Internet. In another embodiment, 
the method may be implemented using a document man- 
agement system to administer files related to the steps in the 
method. These files may assist a user in the creation of 
required documentation. A document management tool may 
be integrated with the document management system to 
associate documentation with steps in the method. A navi- 
gator tool may be employed to create a graphical display of 
the steps in the method using data contained in the files. 
Another embodiment of the present invention uses Web- 
DAV-based communications to coordinate access to mul- 
tiple document repositories. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0017] A more complete understanding of the present 
invention and advantages thereof may be acquired by refer- 
ring to the following description taken in conjunction with 
the accompanying drawings, in which like reference num- 
bers indicate like features, and wherein: 

[0018] FIG. 1 is a flowchart depicting the steps in a 
method for producing more mature products in accordance 
with an embodiment of the present invention; 
[0019] FIGS. 2A-2J are flowcharts depicting the steps of 
the process stage of organization management in accordance 
with embodiments of the method of FIG. 1; 

[0020] FIGS. 3A-3D are flowcharts depicting the steps of 
the personnel stage of organization management in accor- 
dance with embodiments of the method of FIG. 1; 
[0021] FIGS. 4A-4F are flowcharts depicting the steps of 
program management in accordance with embodiments of 
the method of FIG. 1; 

[0022] FIGS. 5A-50 are flowcharts depicting the steps of 
project management in accordance with embodiments of the 
method of FIG. 1; 

[0023] FIGS. 6A-6B are flowcharts depicting the steps of 
delivery management in accordance with embodiments of 
the method of FIG. 1; 

[0024] FIGS. 7A-7E are flowcharts depicting the steps of 
analysis stage of the delivery management of FIG. 6A in 
accordance with embodiments of the method of FIG. 1; 
[0025] FIGS. 8A-8J are flowcharts depicting the steps of 
design stage of the delivery management of FIG. 6A in 
accordance with embodiments of the method of FIG. 1; 
[0026] FIGS. 9A-9M are flowcharts depicting the steps of 
build and test stage of the delivery management of FIG. 6A 
in accordance with embodiments of the method of FIG. 1; 



US 2006/0235732 Al 



3 



Oct. 19, 2006 



[0027] FIGS. 10A-10F are flowcharts depicting the steps 
of deployment stage of the delivery management of FIG. 6 A 
in accordance with embodiments of the method of FIG. 1; 
[0028] FIGS. 11A-B, 12 and 14 depict systems for imple- 
menting the method of FIGS. 1-10F in accordance with 
various embodiments of the present invention; and 

[0029] FIGS. 13A-J illustrate display images from the 
system of FIG. 12 in accordance with a preferred embodi- 
ment of the present invention. 

DETAILED DESCRIPTION OF THE 
PREFERRED EMBODIMENT 

[0030] As generally illustrated in FIG. 1, the present 
invention provides a CMM in a BOX method 10 for easing 
and speeding an organization's transfonnation toward 
higher levels of the above-described CMM hierarchy. The 
CMM in a BOX mediod 10 generally comprises the steps of 
getting started 20, organization management 100, program 
management 400, project management 500, and delivery 
management 600. As suggested in FIG. 1, the CMM in a 
BOX method 10 performs as a cycle in which actions 
performed during the organization management 100 help 
control the current steps of program management 400, 
project management 500, and delivery management 600. 
Subsequently, the actions performed during program man- 
agement 400, project management 500, and delivery man- 
agement 600 adjust the step of organization management 
100. Each of these steps of CMM in a Box method 10 is 
described in greater detail below. 

[0031] In these discussions, it should be appreciated that 
the various steps of the CMM in a Box method 10 preferably 
include the creation or updating of various documentation 
(or monuments) that detail and verify the execution of tasks 
performed by the organization. These documents may be 
used to demonstrate compliance with the higher levels of the 
CMM or CMMI. Some of these documents are listed 
directly with the associated steps, but a complete listing is 
beyond the scope of the present application. A short listing 
and summary of some of the various documents that may be 
created or updated during the steps of the CMM in a Box 
method 10 is listed below in Table 1. 
[0032] The CMM in a BOX method 10 begins with getting 
started step 20. In step 20, the organization prepares to 
initiate the other steps in the CMM in a BOX method 10. In 
particular, the organization may review the requirements of 
the various management steps 100, 300, 400, and 600. 
Similarly, the organization may review the CMM or CMMI 
and their general requirements in order to better understand 
the goals to be accomplished during the various steps of the 
CMM in a Box method 10. 
Organization Management 

[0033] As illustrated in FIG. 1, Organizational Manage- 
ment 100 is divided into two stages, process step 200 and 
personnel step 300. The Organization management step 100 
generally concerns activities related to the structure and 
activities of an organization. The process stage 200 contains 
the methodologies, process flows, tools, and templates to 
create and maintain a Software Engineering Process Group 
(SEPG). It should be noted that in the CMMI, the SEPG is 
replaced by a Process Group to allow for the inclusion of 
systems engineering. Thus, this application uses the SEPG 



to refer to a group overseeing software and non-software 
processes. As suggested by its title, the personnel stage 300 
contains the methodologies, process flows, tools and tem- 
plates to perform organizational design and development, 
measurement performance, and conduct organizational 
training. 

[0034] As depicted in FIG. 2A, the process stage 200 
consists of the steps of planning and organizing a SEPG, step 
201; and of managing and improving the organization's 
processes, step 202. Step 201 is further subdivided into 
planning SEPG project execution (step 210) and organizing 
SEPG project resources (step 220). Likewise, managing and 
improving the organization's processes in step 202 may be 
subdivided into controlling SEPG project work (step 230); 
rolling out and supporting SEPG projects (step 240), com- 
pleting the SEPG project 290, and controlling process 
improvement (step 203). In turn, the step of controlling 
process improvement, step 203, consists of conducting a 
super SQA review, step 250; conducting assessments, step 
260; conducting quarterly surveys, step 270; and conducting 
process improvements, step 280. 

[0035] In the planning and organizing of the SEPG in step 
201, the organization first performs the planning of the 
SEPG project execution, step 210. While planning SEPG 
project execution in step 210, the SEPG defines its process 
improvement plan and subordinate plans for the fiscal year. 
Since the SEPG is a continuously operating project, plans 
are reviewed and updated annually, at a minimum, usually 
with the beginning of a new fiscal year. Step 210 begins at 
the initiation of the project to define the pieces of an initial 
project plan and all subordinate plans that should be used to 
manage the execution of the project. Using this information, 
the organization seeks to develop a SEPG project plan, a 
SEPG work plan, a communication and sponsorship plan, a 
configuration management plan, a risk management plan, 
and a training needs matrix, as these objects are defined in 
the CMM. The organization further performs decision analy- 
sis and resolution during the planning of the SEPG project 
execution, step 210. 

[0036] One possible process for planning the SEPG 
project execution, step 210, is generally depicted in FIG. 
2B. In an initial aspect of the planning a SEPG project 
execution, step 210, the organization tailors the CMM in a 
BOX method 10 as needed. Specifically in step 212, the 
organization determines whether to waive or skip steps in 
the CMM in a BOX method 10 as required by organization 
or the particular project. For instance, the organization skip 
tasks that are inapplicable to a project and therefore 
unneeded to either achieving higher levels of maturity in the 
CMM or to develop more mature products. 

[0037] Another step in the SEPG project execution, step 
210, is to develop a project plan, step 214. The project plan 
describes the project approach for the project timetable, 
metrics, organization, supplier agreement management, 
communication and sponsorship strategy, training, quality 
initiatives, software system development process, configu- 
ration management, logistics, facilities, tools, and purchas- 
ing. It further describes the project approach for training, 
metrics tracking, and roles and responsibilities on the 
project. The organization may also use Decision Analysis 
and Resolution (DAR) to develop the Project Plan, as 
defined in the CMMI. 
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[0038] The organization may further develop subordinate 
plans, step 216. The development of the appropriate subor- 
dinate plans, step 216, satisfies the needs of the project, such 
as the creation of subordinate plans for subcontractor man- 
agement, risk management, communication and sponsor- 
ship, and configuration management, all of which are 
described in greater detail below. In the development of 
subordinate plans, step 216, the organization may further 
create a work plan. For instance, the organization may create 
a "bottom-up" or task-level project work plan based upon 
estimates where critical paths and dependencies are defined 
and managed within a project work-planning tool, such as 
Microsoft Project and Project Workbench®. 

[0039] Another aspect of the SEPG project execution 
process, step 210, is to develop project estimates, step 218. 
The organization may develop project estimates, step 218, 
using an estimating tool as a starting point for the estimates. 
For instance, estimates may be developed using the follow- 
ing steps: (1) tailor tasks and estimating model; (2) deter- 
mine estimating factor values; (3) define work packages; (4) 
determine a timeline for the estimate; (5) reconcile a present 
estimate to an initial estimate; and (6) document assump- 
tions used to form the estimates. The organization preferably 
further validates any estimates by verifying estimates 
against estimates or actual results from comparable projects. 
To form accurate estimates of available resources, the orga- 
nization should further consider other resource-tapping 
activities such as community involvement, recruiting, men- 
toring, and training, when evaluating resources. 

[0040] Returning to FIG. 2A, the organization then con- 
tinues the process stage 200 and the planning and organizing 
the SEPG, step 201, by organizing the SEPG project 
resources, step 220. During step 220, the SEPG focuses on 
obtaining, assigning and training its human resources, and 
establishing the project's other physical resources including 
installation of tracking tools and document repositories. This 
task is performed iteratively as needed to organize, mobilize 
and manage SEPG resources throughout the execution of the 
project. The organization performs step 220 as needed to 
organize the project's human resources, to establish other 
resources, to make work assignments and to any training 
needed to enable resources, 'fuming to FIG. 2C, the first 
step in organizing the SEPG project resources in step 220 is 
to refine resource needs, step 221. In this step 221, the 
organization defines the team organization structure, sched- 
ules the work, and defines the human and physical resource 
needs of the project. These tasks are performed in view of 
each project's requirements. By refining resource needs in 
step 221, the organization helps to ensure that project 
staffing and facilities needs are met on a timely basis without 
affecting the completion date and the quality of the work. 
The organization may complete tins refining of resource 
needs in step 221 by: (1) determining project organization 
structure; (2) balancing a development schedule using 
human resource guidelines; and (3) refining physical 
resource needs that were outlined in the logistics, facilities, 
and tools section of the project plan formed in step 214. 

[0041] Returning to FIG. 2C, the organization continues 
the organization of the SEPG process resources in step 220 
by establishing project standards and goals, step 222. The 
establishment of project standards and goals in step 222 is 
accomplished by developing, modifying, and adopting 
administrative and project-specific project standards and 



procedures. Examples of administrative procedures are 
employee availability checklists, time accounting proce- 
dures, status reporting, vacation scheduling, etc. Project 
standards and procedures include design and development 
standards, and the use of project specific tools. 

[0042] The organization continues the organizing the 
SEPG process resources in step 220 through organizing a 
project team in step 223, also illustrated in FIG. 2C. The 
selection of project team members is based on project 
requirements. Other elements in the organization of a project 
team are the fmalization of the project team's organization 
structure and documentation in an organization chart in the 
project plan. The organization should further update the 
training needs matrix to document: (1) the training required 
of each project team member and (2) the proposed means for 
fulfilling the training. The training needs matrix is further 
used to track project team member training. In another 
implementation, organizing a project team in step 223 may 
further require the organization to determine, as a team, the 
project's mission, vision, and charter, and then to document 
these determinations in the project plan and orientation 
binder that are created as required to achieve higher maturity 
levels in the CMM. 

[0043] Returning to FIG. 2C, another task in the organi- 
zation of SEPG project resources is to establish other 
resources indirectly needed for the SEPG project, step 224. 
Specifically, the organization performs this task by organiz- 
ing the physical resources, such as hardware or software, 
provided by program management and developing the ori- 
entation and/or training needed to support the activities of 
the project team. The establishment of other resources in 
step 224 helps create a work environment that promotes 
communication, collaboration, and group cohesion. 

[0044] Also, as illustrated in FIG. 2C, the organization of 
SEPG project resources in process 220 further includes 
enabling resources, step 225. An organization performs this 
step 225 to orient and train team members, to coach and 
evaluate team members, and to manage the physical 
resources assigned to the project. The enabling of resources 
in step 225 aids the project manager in motivating and 
challenging team members, while helping to ensure that 
various project personnel believe their work to be important. 
Specifically, the organization should communicate the 
project's mission, vision, and charter to new team members. 
Large projects may also elect to formalize these items at the 
program level, and projects may conduct one or more 
meetings that include all team workers. 

[0045] Referring to FIG. 2A, another element in the 
process stage 200 is to manage and improve the organiza- 
tion's processes, step 202. The first step in the management 
and improvement of process is the control of SEPG project 
work in step 230. During the control of SEPG project work 
in the step 230, SEPG project management monitors the 
execution of the project against project plan and makes 
adjustments as necessary. Project Status Reports are pre- 
pared for the Project Sponsor. Potential and actual problems 
are identified through the measuring and monitoring of 
progress and performance against the SEPG Project Plan. 
Depending on the type of problem identified, an Issue, Risk, 
System Investigation Request (SIR) or Change Request 
(CR) is logged. The SIRs and the CRs are described in 
greater detail below. SEPG Project management is expected 
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to take appropriate corrective actions to resolve problems 
that are discovered. The controlling of SEPG project work in 
the step 230 is also illustrated in FIG. 2D and is now 
described in greater detail. The controlling of SEPG project 
work in the step 230 includes releasing work packages, step 
231. Work packages are generally described in the CMM 
criteria and generally relate to the tasks and functions given 
to the various workers in a project. To release work pack- 
ages, the organization should (1) assemble and release work 
packages according to the work plan and (2) communicate 
the requirements of the work packages to the assigned team 
members. The project team then performs the work needed 
to develop the required deliverable good. During step 231, 
the organization preferably acts to ensure that each team 
member understands assigned responsibilities, including tar- 
get dates and budgets. Furthermore, the organization should 
implement the project so that each team member (1) is able 
to provide input regarding various responsibilities and (2) 
accepts these responsibilities. 

[0046] As depicted in FIG. 2D, a following task in the 
control of SEPG project work, step 230, is measuring 
performance, step 232. The task of measuring performance 
in step 232 generally includes capturing actual results and 
calculation of metrics in order to manage performance. The 
capture metrics are outlined in the SEPG project plan 
formed in step 214 and include cost, effort, scope, quality, 
and schedule. The organization should further track project 
infrastructure and technical requirements, such as hardware, 
software, and performance requirements that were outlined 
during planning in step 210. The organization should also 
analyze any deviations from the project plan arid identify, in 
a timely manner, the causes for the deviations. 

[0047] Concurrent with measuring of performance in the 
step 232 is managing performance, step 233, as illustrated in 
FIG. 2D. Managing performance in step 233 generally 
requires the organization to manage project performance 
against the previously defined project and work plans. To 
manage project performance in view of the project and work 
plans, the organization proactively assesses performance, 
status, quality and risk. When the actual results from the 
development of the project do not match the plans, the 
organization should further determine alternative goals or 
actions. The implementing organization may further obtain 
approval for corrective actions, and then take corrective 
actions. The corrective actions may include, but are not 
limited to, work process changes, team building, training, 
increased or decreased supervision, work assignment 
changes, reassignment of team members, initiation of risk 
responses, the change of requests to be pursued with pro- 
gram management as part of the configuration management 
process, project replanning changes that specify needed 
modifications to the project plan, project plan revisions 
(work package changes, etc.) or escalation to program 
management. The organization should also reevaluate 
project decisions throughout the project life cycle, when 
various project triggers or other issues, risks, etc. arise. The 
organization may also manage team member performance 
according to organizational and industry standards and tools. 

[0048] Continuing with FIG. 2D, following the measuring 
of performance in step 232 and the managing of perfor- 
mance in step 233, the organization communicates project 
status, step 234. During step 234, the organization generally 
develops and communicates project status to all project 



stakeholders according to the project plan. The project 
stakeholders include project and senior management and 
other affected groups. The organization may further conduct 
status and review meetings involving affected groups as 
appropriate. During the communication of project status in 
step 234, the organization should document meeting minutes 
as required for the CMM. 

[0049] Continuing with FIG. 2D, following the commu- 
nication of project status in step 234, the organization 
obtains acceptance of interim deliverable goods, step 235. 
Obtaining acceptance of interim deliverable goods in step 

235 generally requires that the organization obtain accep- 
tance of interim deliverables by all designated stakeholders, 
as appropriate, at key interim points throughout the project 
life cycle. Any acceptance of final deliverables takes place 
in connection with completing the program. 

[0050] Concurrent with the above-described steps 231- 
235, another task in the control of SEPG project work in step 
230 is to execute project management processes, step 236. 
The organization should execute step 236 m conjunction 
with other project control activities, such as measurement 
activities and status reporting. Also, the project management 
processes may occur continuously, periodically, or may be 
event driven. One project management process in step 236 
is risk management, which addresses the identification, 
analysis, and avoidance/mitigation aspects of risk manage- 
ment on a project. During risk management, the organization 
may perform risk identification, during which the organiza- 
tion identifies, names, and describes the various risks. The 
organization should further generate a list of specific incre- 
mental risks in the project's risk tracking tool. For instance, 
the organization may document known triggers for a risk, 
the potential damage for each risk item, and references for 
the sources of risk. Another risk management task in step 

236 is risk analysis, in which the organization analyzes the 
identified risks. In the risk analysis, the organization should 
classify the risks and include any additional information 
necessary to support the analysis. The organization may then 
select a rank/prioritized list of top risks. For instance, the 
organization may create a list of the top five risks to a 
project. Another risk management task is risk avoidance and 
mitigation. Risk avoidance activities address the sources of 
a risk, thereby reducing the probability that it would become 
a problem. For a top ranked or prioritized risk, the organi- 
zation should identify how the risk can be avoided. Risk 
mitigation measures attack the consequences of a risk, 
reducing the risk's potential impact on the project. For the 
top ranked/prioritized risks, the organization may identify 
actions to reduce the impact of the risk if it occurs. The 
organization may also use Decision Analysis and Resolution 
(D.AR) to assess the risks, where DAR is defined above. 
Many automated risk management applications are com- 
monly available, and an organization may choose from these 
various risk management applications as needed to best 
fulfill the needs of the organization. 

[0051] Another task in the execution of project manage- 
ment in step 236 is scope management, which addresses the 
acceptance of requirements to define scope and the require- 
ments to change control process. For instance, one scope 
management task is requirements development. During the 
task of requirements development, the organization identi- 
fies and documents requirements needed to promote and 
ensure bidirectional traceability, so that the organization 
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may trace requirements between the development and the 
testing of the requirements. As with all work products, 
requirements are preferably placed under configuration 
management (CM), as defined in the CMM1. Another scope 
management task is requirements acceptance, during which 
the organization documents and reviews requirements with 
all affected groups and obtains acceptance from the affected 
stakeholders. The organization should further establish base- 
line standards for satisfying the requirements. Another scope 
management task for the organization is making any 
required changes to the requirements and their baselines. 
The organization generally follows the project's change 
control process for any changes to baselined requirements. 
Namely, the organization submits a change request; reviews 
a change request; performs impact analysis, including cost, 
schedule and efforts impacts; determines disposition: imple- 
ments change, including associated impact to other work 
products and activities; and notifies requester and affected 
groups. Again, the organization may determine if it is 
necessary to use DAR to assess changes in scope. 

[0052] Another project management process in step 236 in 
the execution of the project management processes is con- 
figuration management. This task addresses the set of activi- 
ties performed to establish and maintain the integrity of the 
project work products throughout the project's life cycle. 
One set of configuration management tasks relates to con- 
figuration identification activities. During the configuration 
identification activities, the organization identifies, names, 
and describes each of the configuration items that should be 
placed under configuration management. In particular, all 
work products should be placed under some type of con- 
figuration management. During the configuration identifica- 
tion activities, the organization generally uses the CM plan 
to define a baseline for the configuration items and to 
indicate the level of configuration management for each 

[0053] Another configuration management process in step 
236 is the configuration of control activities. Generally, the 
organization requests, evaluates, approves or disapproves, 
and implements changes to the baselined configuration items 
defined during the configuration identification activities. All 
of the configuration items should be archived and placed 
under the project's documented change control process. 

[0054] Configuration of status accounting activities is 
another configuration management process in step 236. 
During this process, the organization records and reports die 
status of the project's configuration items. Similarly, the 
organization should further perform configuration audits. 
Specifically, the organization may, using the CM plan, 
determine the extent to which actual configuration items 
reflect the planned configuration items. The purpose of this 
task is to ensure that the entire configuration is correct and 
complete. Hie organization should further document results 
as required in the CMMI. 

[0055] Another project management process of the execu- 
tion of the project management process in step 236 is issue 
management and escalation. This task involves the identi- 
fication and documentation of issues using an issue tracking 
tool, as well as a review of the issue and an analysis of any 
impact on deliverables, scope, contingency, resources, costs, 
schedule, and/or quality. Specifically, the organization 
should identify a resolution approval party, an issue's owner, 



and determine expected time frames. The organization may 
also determine if it is necessary to use DAR to assess the 
issue, as described above. The organization may further 
research and identify issue solution alternatives. Subse- 
quently, the organization may refer the issue to program/ 
senior management when: (1) the project cannot resolve the 
issue internally, (2) when the issue impedes the progress of 
a project, and when the issue is beyond the authority of the 
project manager to resolve. These are generally issues that: 
(1) cannot be resolved within a project team, (2) are resolv- 
able with action items, (3) can be escalated to the next level, 
(4) Are reactively discovered during the course of develop- 
ment, (5) affect program/project scope, costs, schedule, 
projected business performance, or high level design, (6) 
affect multiple projects or releases, and/or (7) involve groups 
outside the project that affect project delivery. The organi- 
zation should accordingly monitor issues status and approve 
or reject resolutions. At the same time, the organization 
should communicate resolutions to stakeholders and 
affected parties and take corrective action as described 
above in the context related to management of performance 

[0056] Returning to FIG. 2D, another step during process 
of controlling the SEPG project work in step 230 is updating 
the project plan and subordinate plans, step 237. In particu- 
lar, throughout the life cycle of the project, the project plan 
and subordinate plans (Risk Management, Configuration 
Management, Work Plan, Subcontractor Management Plan, 
Community and Sponsorship Plan) should be updated as 
appropriate by the organization to reflect any changes on the 
project that would effect the content of the documentation. 

[0057] Referring again back to FIG. 2A, another task of 
the management and improve process 202 in project stage 
200 is the rollout and support of SEPG projects, step 240. 
During the rollout and support of SEPG projects in step 240, 
new projects to be supported by the SEPG are identified and 
SEPG processes and tools are delivered to them. SEPG 
Liaisons may conduct process reviews of the SEPG-sup- 
ported projects. Other project -created items referenced dur- 
ing the rollout and support task include the Service Level 
Agreement, Tailoring & Waiver Request, Metrics Workbook 
and Metrics Plan. The organization performs this task of step 
240 to rollout SEPG processes and tools throughout the 
organization. The process of rollout and support of SEPG 
projects in step 240 is illustrated in greater detail in FIG. 2E. 
Specifically, the rollout and support of SEPG projects in step 
240 comprises the steps of identifying new projects, step 
241; assigning a SEPG liaison, step 242; conducting a 
project kickoff, step 243; approving or disapproving waiv- 
ers, step 244; collecting project metrics, step 245; conduct- 
ing best practices reviews, step 246; reporting best practices 
status, step 247; and conducting project close out, step 248. 

[0058] Referring to FIG. 2E, during the identification of 
new projects in step 241, the organization should identify 
new projects that are in the planning stages. Then, in step 
242, a SEPG rollout team leader assigns a SEPG liaison by 
evaluating the current workload among the available SEPG 
liaisons and select the most appropriate SEPG liaison for the 
current project. The rollout team leader preferably discusses 
the assignment with the SEPG liaison and sends a memo to 
the SEPG liaison informing him or her of the assignment, 
with a copy to the project manager and the SEPG program 
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[0059] Continuing with FIG. 2E, the next step of con- 
ducting a project kickoff in step 243 is conducting a kickoff 
meeting, preferably within 2 weeks of notification of support 
to be provided by SEPG. The SEPG liaison should schedule 
a time to meet with the project management team to discuss 
the kickoff. The SEPG liaison should also ask a project 
manager for project documentation such as the proposal, the 
statement of work, estimating tool estimates, and the work- 
plan, if available. This discussion is to establish the project 
organization, identify projects to support, and to ascertain 
the scope of the SEPG effort. 

[0060] Referring again to FIG. 2E, the next task in the 
rollout and support of SEPG projects in step 240 is to 
approve or disapprove waivers, step 244. In particular, the 
SEPG liaison or SEPG manager should work with the 
project or proactively identify any area where a project may 
need a waiver. A waiver request template should be available 
through the SEPG or through the SEPG liaison. A senior 
management official should sign the waiver request form, 
thereby acknowledging its risk and impact to the project. 
Also, the SEPG liaison should review the waiver request 
form for completeness and determine the disposition of the 
waiver request. The SEPG liaison then forwards the waiver 
request form to the SEPG project manager with a recom- 
mendation for disposition. Subsequently, the SEPG liaison 
informs the project manager of the disposition of the waiver 
request. 

[0061] Continuing with FIG. 2E, the next task is to collect 
project metrics, step 245. Step 245 may include one or more 
undertaking that help to ensure that the pro ject metrics are 
collected in an organized and efficient manner. These under- 
takings may include collecting monthly project metrics, 
collecting best practice reviews, collecting quality review 
results, collecting stakeholder scorecard data, and collecting 
people satisfaction survey results. 

[0062] Continuing with FIG. 2E, another step is to con- 
duct best practices reviews, step 246. With the conducting of 
best practice reviews, the SEPG liaisons should conduct 
monthly best practice reviews with project management in 
order to track and monitor compliance with CMMI require- 
ments. The review criteria are based on the CMMI process 
areas and can be found within a best practices matrix. The 
reviews identify nonconformance items and areas for 
improvement. Hie SEPG liaisons should review the infor- 
mation gathered from the team and enter comments into the 
notes/comments section of the first best practice review 
matrix. During the meeting, the SEPG liaisons and project 
managers should review the matrix and determine which 
items have been met and those that would require additional 
information or documentation (artifacts). Based on the 
review, the SEPG liaisons should complete the best practice 
matrix with documentation on additional information 
required from the project. Once the project reaches substan- 
tially complete compliance with the identified best practices, 
the best practice review focus becomes one of continued 
compliance aid includes project team leaders and project 
team members. The SEPG liaisons should document and 
spot-check areas for compliance based on past reviews. 
These interviews may be conducted with or without project 
management in step 500, described below. 

[0063] Continuing with FIG. 2E, the next step is to report 
best practice status, step 247. There are two ways to report 



on the best practice status. The SEPG liaison may document 
Non-Conformance Items (NCI) and issues in a best practice 
notes/comments section and submit this to project manage- 
ment after the conclusion of the Best Practice review, 
preferably within two days. The project manager generally 
has a short time, such as one week, to provide a response for 
each NCI, including a target completion date for correcting 
the NCI. Alternatively, the SEPG liaison may complete a 
best practice "Dashboard" report with updated scores, open 
items, and risks. The report should be sent to project 
management and SEPG rollout and program leaders. 

[0064] Continuing with FIG. 2E, the next step is to 
conduct project close out, step 248. The organization may 
implement phase close out. In phase close out, the SEPG 
liaison may approve or disapprove the waivers, collect 
project metrics, conduct best practice reviews, and report on 
best practice status, etc. This process of rolling out and 
support of SEPG projects, along with the control of process 
improvements (step 203) described below, may then be 
repeated until the project is closed out. Next, in project 
closed out, the SEPG liaison works with the project manager 
and the management team to evaluate the overall impact and 
value of the SEPG program on the project. This evaluation 
should be done through the completion of a project close-out 
memo, verification of updates to the internal corporate 
resource by the project knowledge champion, verification of 
submission of the project's actual and estimated values to 
owners of the estimating tool via the profiling tool, collec- 
tion of final project metrics, and collection of best practice 
and SEPG suggestions and comments. 

[0065] Following the conducting of the close out in step 
248, the organization may complete the SEPG projects in 
step 290, as depicted in FIG. 2.1. To complete the SEPG 
projects in step 290, the SEPG Liaison reviews the Closing 
Memo and SQA Debrief created by projects that are com- 
plete and no longer require SEPG support. Specifically, the 
organization verify the completion of the supported projects, 
review the documentation produced in steps 230 and 240, 
and generate a list of best practices as desirable to produce 
a more mature product, respectively steps 292-296. 

[0066] Referring back to FIG. 2A, another task of the 
management and improvement process, step 202, in the 
project stage 200 is to control process improvements, step 
203. The control of process improvements in step 203 brings 
together the tasks associated with controlling and conduct- 
ing process improvement. As highlighted in the methodol- 
ogy, the Control Process Improvement, Rollout & Support 
SEPG Projects, and Complete SEPG Projects tasks are 
iterative in nature. Once processes and tools are improved, 
the SEPG is responsible for delivering these new processes 
and tools to its projects. Improving the control process in 
step 203 is comprised of the following steps: conducting a 
super software quality assurance (SQA) review (step 250), 
conducting mini-assessments and appraisals (step 260), con- 
ducting intermittent surveys (step 270) and conducting pro- 
cess improvements (step 280). 

[0067] One aspect of improving the control process in step 
203 is to conduct a super SQA review, step 250. In step 250, 
the SEPG plans and organizes a Super Software Quality 
Assurance (SQA) review of its documents. A report is 
prepared based on the findings and reviewed with the SEPG 
Team. The results of this review help the SEPG to improve 
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internal processes. The organization performs this step 250 
to conduct software process and work product quality assur- 
ance reviews to verify project adherence to standards and 
procedures, such as any identified best practices. The quality 
program section of the Project Plan is described above in 
greater detail within the text accompanying FIG. 2B. Turn- 
ing to FIG. 2F, the process of conducting a super SQA 
review in step 250 is described in greater detail. The first 
task of conducting the super SQA review in step 250 is to 
complete a SEPG project plan. In step 251, the process 
improvement (PI) team leader typically (1) identifies docu- 
ments and processes to be reviewed; (2) ensures that docu- 
ments in the Project Plan and Work Plan are consistent; (3) 
identifies Super SQA reviewers, reviewees, and review 
criteria, (4) identifies roles and responsibilities; (5) identifies 
SQA metrics; (6) references the SQA plan in the quality 
section of the project plan; and (7) creates the SQA Plan. 

[0068] In the next step of conducting the super SQA 
review of step 250, the organization prepares for the super 
SQA review, step 252, as depicted in FIG. 2F. In one 
implementation of step 252, the PI team leader sets the super 
SQA review expectations. The PI team representative also 
submits reminder notifications to the super SQA reviewer 
based on any scheduled super SQA reviews, provides the 
Super SQA Reviewer with the Super SQA Reviewer training 
presentation and the SEPG Program SQA Plan, and provides 
the super SQA reviewer with standards and supporting 
documents to be reviewed. The PI team representative may 
further provide the super SQA reviewer with document 
owner contact and availability information, as defined in the 
CMMI. The super SQA reviewer then typically gathers and 
reviews criteria/standards and supporting documents from 
the PI team representative, reviews any super SQA reviewer 
training presentation, and schedules meetings with docu- 

[0069] Referring to FIG. 2F, the next step of conducting 
the super SQA review of step 250 is to conduct the super 
SQA review, step 253. The super SQA reviewer should 
review processes and documents against review criteria/ 
standards, conduct interviews with document owners, iden- 
tify nonconformance items, and follow up with the docu- 
ment owners as needed for meeting with the requirements of 
the desired CMM level. The document owner participates in 
the interview with the super SQA reviewer and remains 
available to answer questions. The PI Team Leader should 
also remain available to answer questions. 

[0070] In the next step 254, the organization, through the 
SQA reviewer, prepares an SQA report to document a 
detailed summary of findings and recommendations, as 
illustrated in FIG. 2F. Specifically, the SQA Report should 
include an item number, the date reported, and an accurate 
description of nonconformance items. The SQA reviewer 
may further distribute the SQA Report to the PI Team 
Leader, and schedule discussion of nonconformance items 
with the SEPG Program Lead. The PI team representative 
also prepares and documents responses in the SQA Report, 
including an indication of whether the PI team representa- 
tive agrees or disagrees with the reason statement, or oth- 
erwise determines the findings to be not applicable to the 
particular organization or project. 

[0071] Subsequently, the organization should discuss non- 
conformance items, step 255 in FIG. 2F. In step 255, the 



super SQA reviewer typically schedules and conducts a 
discussion of nonconformance items with the PI team leader, 
as well as verifying an adequate resolution of nonconfor- 
mance items. Likewise, the PI team leader should discuss 
nonconformance items with the Super SQA Reviewer and 
refer disagreement items for facilitation to the SEPG Pro- 
gram Leader. A PI team representative should update the 
SQA report with proposed resolution(s) and projected 
completion date(s) for proposed changes/actions, and update 
and return the report, as well as all necessary documents, to 
the SQA reviewer for verification. The PI team representa- 
tive further creates the System Investigation Requests (SIRs) 
and/or Change Requests (CRs) as necessary for the CMMI. 
The SIRs correspond to reports created to document errors 
in the product, and CRs conversely correspond to enhance- 
ments in the product that are beyond the scope of the original 
product. A SEPG liaison may then review and resolve 
escalated nonconformance items. 

[0072] Returning to FIG. 2F, the next step of conducting 
the super SQA review of step 250 is to track the super SQA 
metrics, step 256, by having the super SQA reviewer send 
the final report to the PI team leader. The PI team leader then 
forwards the final report and metrics to SEPG program 
leader, including metrics such as SQA schedule variance, 
and the number of nonconformance items. The PI team 
leader further tracks and reports on all open nonconfor- 
mance items, while keeping project copies of documenta- 
tion/reports. 

[0073] Returning to FIG. 2A, the next step in improving 
the control process in the step 203 is to conduct assessments, 
step 260. In step 260, the SEPG coordinates activities to 
determine the stale of an organizations processes and prac- 
tices. This assessment can take many forms and can range 
from informal process assessments, mini-appraisals or full- 
scale evaluations. In any of these situations the organization 
can utilize outside contractors to conduct the review. Step 
260 generally includes three stages: preparation, an on-site 
period, and wrap-up. After a series of interviews and review 
of documentation, the assessment results are then presented 
back to the organization. The organization should follow the 
same basic process when conducting an appraisal. In both 
cases, the organization may utilize an external group to 
execute the mini-appraisal and/or assessment. The process 
of conducting the mini-assessments and appraisals in step 
260 is more fully illustrated in FIG. 2G. 
[0074] As depicted in FIG. 2G, the first task in the 
assessments in step 260 is to select projects, step 261. In step 
261, the organization carefully selects projects used for the 
assessment in order to paint an accurate picture of the 
organization's processes. Generally, from one to four 
projects should be selected for assessment. Projects may be 
selected using the following criteria: (1) the project should 
be representative of the work (present and future) of the 
organization, and aligned with the business objectives of the 
organization; (2) the project should have at least six people 
working on it; (3) the project should have a duration of 
greater than three months; and (4) the project should not 
have a critical activity or milestone during the on-site period. 
Additionally, at least one of the projects should be in the 
build stage. Personnel from the selected projects should also 
be available for interviews and presentations. 
[0075] Returning to FIG. 2G, the next task in the mini- 
assessment and appraisal is to assess the development of an 
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onsite schedule, step 262. The core of the assessment during 
step 260 is made up of the onsite period, which usually lasts 
from five to ten days. The onsite period consists of three 
basic activities: (1) garnering information through interview 
sessions with project leaders, team leaders, and functional 
area representatives; (2) mapping information to processes 
areas within the scope of the assessment through consoli- 
dation sessions; and (3) reporting findings and observations 
back to the organization through preliminary and final 
findings presentations. An executive session and a debriefing 
session is conducted to wrap up the on-site period. There is 
no limit to the number of hours spent on a particular activity; 
however, the assessment team is bound to the tasks that need 
to be completed before the next day. Training the assessment 
team is the other activity that can be considered part of the 
onsite period, as required, and can be scheduled just before 
the assessment activities begin. 

[0076] As depicted in FIG. 2G, the next step in step 260 
is to prepare assessment logistics, step 263. During step 263, 
a local assessment coordinator works with the assessment 
team leader to identify and prepare the logistics for con- 
ducting the on-site period. Logistical preparations include 
reservation of rooms for the on-site period (presentation, 
interview, and assessment team rooms); computer and pre- 
sentation equipment (projectors, LAN connections, access 
to a phone, printer, copier, and general supplies); arranging 
for food and beverages, as well as accommodations for the 
assessment (earn, and confirming building/office access for 
the assessment team during the on-site period. 
[0077] The next step in step 260 is to select assessment 
participants, step 264, as depicted in FIG. 2G. In the 
selection of assessment participants in step 264, a good cross 
section of the organization must be considered when select- 
ing assessment participants. This is done through interview- 
ing individuals from each selected project, including the 
project leader, project team members, as well as personnel 
from supporting groups, such as quality assurance, configu- 
ration management, and/or the database group. Individuals 
who have been involved in developing or maintaining 
software in the organization also should be included in the 
list of interviewees. Participants selected for the assessment 
should come from different parts of the project life cycle, 
have at least six months of experience with the organization 
(and at least three months with the project), and be able to 
articulate their observations and opinions about the organi- 
zation and its projects. Selected participants preferably can 
dedicate from six to eight hours to the assessment activities 
during the on-site period. For the assessment to take place, 
the assessment sponsor must be present for the initial and 
final presentations. 

[0078] Returning to FIG. 2G, the next step in the mini- 
assessment and appraisal is to develop organizational aware- 
ness of CMMI, step 265. The organization performs this task 
to train assessment participants on what the assessment will 
involve, how the assessment will be conducted, and what the 
organization expects of assessment participants. Awareness 
activities may include training sessions and distribution of 
awareness materials to everybody in the organization. The 
assessment sponsor, or the organization's management (if 
different from the sponsor), must demonstrate their total 
support for the initiative. 

[0079] As depicted in FIG. 2G, file next step in the 
mini-assessment and appraisal is to collect process informa- 



tion, step 266. Step 266 is performed in preparation for the 
assessment of the collection of the documentation used in 
the current management and technical processes. Selected 
members of the organization fill out a maturity questionnaire 
to provide a baseline for scoping the assessment. The 
appropriate process documentation from both the organiza- 
tion and the projects being assessed should be collected to be 
reviewed by the team for the purpose of developing the 
assessment findings and observations. A documentation 
index should be created and, if required, the collected 
documents should be mapped to the CMMI process areas. 
[0080] Returning to FIG. 2G, the next step in step 260 is 
to conduct the assessment, step 267. In step 267, the 
assessment team visits the organization with the objective of 
mapping the organization's management and development 
processes against the CMMI. In particular, the assessment 
team should be trained. The assessment team should further 
conduct an opening meeting and interview project leaders, 
team leaders, and functional area representatives. The 
assessment team should further review collected documen- 
tation and consolidate information gathered and map it to 
process areas in the CMMI. Subsequently, the assessment 
team should conduct follow-up interviews, as required, and 
prepare and present preliminary findings to management and 
staff. Likewise, the assessment team should prepare and 
present final findings to the organization, incorporating 
feedback received from the preliminary findings presenta- 
tion The assessment team then conducts any executive and 
debrief sessions and prepares a final report. At the conclu- 
sion of the assessment, the assessment team files an assess- 
ment report with the Software Engineering Institute (SEI), 
including with the assessment the final presentation and the 
summary report. 

[0081] Returning to FIG. 2A, the next step in improving 
the control process in step 203 is to conduct a quarterly 
survey, step 270. The organization performs step 270 to 
receive feedback from projects regarding the SEPG pro- 
cesses and tools. During step 270, the SEPG designs and 
delivers a quarterly Process Improvement Survey to the 
projects it supports. The results of this survey are an input 
into the SEPG team's Process Improvement efforts. While 
named a quarterly survey, it should be appreciated that the 
survey may occur at other intervals and time periods. Results 
of this survey should be used to improve SEPG processes 
and tools. The process of conducting the quarterly survey in 
step 270 is depicted in FIG. 2H. The first task is to develop 
a survey process, in step 271, for administering the process 
improvement survey. This survey may be administered by 
the SEPG. The responsibilities for tins task should be 
assigned to a sub-team. In developing the survey in step 271, 
the organization should consider the effect of the survey 
transmission medium and the methods through which the 
survey results will be analyzed. The organization should 
next develop tire survey questions, step 272. The organiza- 
tion should select question on which the SEPG would like to 
receive feedback. Preferably, when developing survey ques- 
tions, the organization should choose nonleading questions. 
The organization should also preferably use a response scale 
that can be easily quantified, such as the Lickert scale. The 
organization should next, in step 273, administer the survey 
using the medium chosen in step 271. At this point, in step 
274, the organization may evaluate and analyze the survey 
results received from respondents using the process devel- 
oped in step 271. The organization may then use the survey 
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results to improve the SEPG processes and tools, step 275. 
During step 275, the organization may also publicize the 
results of the survey. 

[0082] Returning to FIG. 2A, the next step in improving 
the control process in step 203 is to conduct process 
improvements, step 280. The organization performs step 280 
to manage process improvement activities. During step 280, 
the SEPG takes the feedback it received from the SQA 
review, assessments, quarterly surveys, and feedback from 
other sources, and begins translaling this feedback into 
improvements in SEPG processes and tools. Results from 
step 280 will be used to maintain, update, and develop SEPG 
processes, tools, and assets. Step 280 is illustrated in greater 
detail in FIG. 21. 

[0083] As depicted in FIG. 21, the first step in conducting 
process improvements is to maintain and improve processes 
and tools, step 281. In step 281, anyone in the organization 
and its external reviewers may identify a process improve- 
ment opportunity (with a process, template, training, stan- 
dard, tools, or the document repository itself). This could be 
in the form of an error (through a SIR), an improvement, an 
enhancement request (through a CR), or any other process 
improvement concern. The process improvement team 
leader should examine the process improvement opportu- 
nity, and a decision may be made on implementing the 
process improvement. If it is determined that the changes 
will be incorporated into the appropriate process asset 
(process, template, standard, training, etc.) in accordance 
with SEPG standards, then a SIR or CR may be documented 
to capture the change. 

[0084] Returning to FIG. 21, the next step in conducting 
process improvements, step 280. is to define and update 
processes and tools, step 282. In step 282, anyone in the 
organization may identify a new process or tool to be 
defined, documented, and/or built. The first type of process 
to be created is an internal SEPG process that uses a new 
process template to document process flows and descrip- 
tions. The second type of process to be created includes 
processes and tools that are part of the SEPG methodology. 
Process definition is submitted to a SEPG team leader for 
review and approval. If a process is approved, it will be 
scheduled for release to the organization and/or SEPG team, 
depending on the type of process submitted. 

[0085] As depicted in FIG. 21, the next step in conducting 
process improvements, step 280, is to pilot processes and 
tools, step 283. Once the process or tool to be piloted has 
been completed and approved, it is time to determine the 
pilot group, time frame, scope and functionality, roles and 
responsibilities, and entry and exit criteria, as part of step 
283. The SEPG program manager may then work with a 
process asset owner to communicate the pilot's scope and 
expectations with the pilot group. The pilot group will be 
trained on the use and implementation of the process asset. 
The pilot is conducted with the process asset owner provid- 
ing support to the pilot group in terms of providing clarifi- 
cation, additional training, or technical support, as neces- 
sary. At the end of the pilot period, the process asset owner 
debriefs with the pilot group or at least with a representative 
of the group to evaluate the pilot. Strengths and weaknesses 
of the process are identified, documented, and addressed. 

[0086] Returning to FIG. 21, the next step in conducting 
process improvements, step 280, is to roll out processes and 



tools, step 284. In step 284, once feedback from the pilot 
group is incorporated into the process asset, it will be rolled 
out to the organization and/or SEPG team, as necessary. In 
step 284, the SEPG liaisons have the primary responsibility 
of communicating the new processes and tools to the orga- 
nization's projects. 

[0087] Returning again to FIG. 21, the last step in con- 
ducting process improvements, step 280, is to assess and 
evaluate processes and tools, step 285. During step 285, the 
organization determines how processes and tools will be 
evaluated. The organization may further conduct intermit- 
tent or quarterly process improvement surveys. 

Personnel Stage 

[0088] Returning to FIG. 1, a second process within the 
organization management step 100 relates to personnel 
management, step 300. The actions of step personnel man- 
agement in step 300 generally relate to acquiring, organiz- 
ing, and training the organization's personnel as needed to 
encourage the development of more mature products and 
achieve higher levels of CMM maturity. Organizational 
Training of step 300 is generally necessary to enable per- 
sonnel to develop skills to meet specific roles and respon- 
sibilities during solutions delivery in step 600 described 
below. The process of personnel management is generally 
depicted in FIG. 3A and comprises the actions of designing 
a performance measurement infrastructure, step 310; execut- 
ing organization design and development, step 320; and 
designing and deploying training, step 330; and is now 
briefly described. 

[0089] The designing of a performance measurement 
infrastructure in step 310 generally relates to planing activi- 
ties related to performance measurement to provide the 
organization with a means for judging the effectiveness of 
the organization. The designing a performance measurement 
infrastructure in step 310 is summarized in FIG. 3B. The 
first step in step 310 is to validate and reach agreement on 
organization strategy, step 312. Step 312 generally involves 
the organization's key stakeholders in the development 
and/or validation of the organization's strategy, specifically 
the organization's mission, vision, and overall objectives. 
Because performance measurement cascades down from the 
organization strategy, the organization's strategy should be 
understood and agreed upon by those accountable for imple- 
menting it. 

[0090] Returning to FIG. 3B, the next step in designing a 
performance measurement infrastructure in step 310 is to 
produce a performance measurement scorecard, step 314. In 
step 314, the organization uses a balanced scorecard to 
measure performance. The balanced scorecard is a measure- 
ment tool that translates strategic objectives into a coherent 
set of performance measures. The scorecard is "balanced" 
because it measures both leading and lagging indicators. 
These indicators are expressed in financial and nonfinancial 

[0091] Subsequently, in step 316, the organization imple- 
ments the scorecard, as depicted in FIG. 3B. Implementing 
the scorecard generally requires that the specific information 
for performance goals, metrics, and targets be collected from 
the front lines. Furthermore, the organization should com- 
pile at the strategic level each performance perspective, 
objective, metric, and target. Also, the organization should 
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create and communicate top down, bottom up, and interac- 
tive performance measures. Subsequently, the organization 
should solicit feedback to test the effectiveness of metrics 
and how the performance measures fit in with the organi- 
zation strategy. 

[0092] Turning to FIG. 3C, the next step in the personnel 
stage 300 is to execute the organization design and devel- 
opment, step 320. The organization performs step 320 to 
plan activities related to organization design and develop- 
ment. Step 320 involves coordinating the tasks associated 
with defining a strategy for the organization, assessing the 
organization against this strategy, and deigning and imple- 
menting a new organization. Note that step 320 assumes that 
the organization has a Human Resource Organization with 
the skills to design and implement new elements of the 
organization. The organization should to have experience in 
organization design and development. The substeps of the 
organization of design and development in step 320 are 
illustrated in FIG. 3C. 

[0093] The first task in step 320, as illustrated in FIG. 3C, 
is to identify an organization strategy, step 321. In step 321, 
business outcomes, core competencies and guiding prin- 
ciples are defined. These definitions will position the orga- 
nization relative to business goals and objectives, vision and 
mission, management philosophy, customer values, critical 
behaviors and competitive environment. Specifically, the 
organization should identify an organization strategy before 
detailed organization design. The organization should be 
designed to reflect not only where the company is relative to 
strategy, philosophy, and the value proposition of its cus- 
tomers, but also where it needs to achieve a competitive 
advantage in the future. The organization strategy sets the 
direction by defining business outcomes, core competencies, 
and guiding principles that will be used to anchor the 
organization design and development process. 

[0094] As depicted in FIG. 3C, the next step in the 
execution of the organization design and development in 
step 320 is to conduct an organization assessment, step 322. 
It should be noted that the assessment differs from assess- 
ment used with SEPG. The organization assessment helps to 
identify the supports and barriers to transformation and build 
a case for implementation. An organization assessment in 
step 322 consists of assessing an organization's current 
situation, its future aspirations, and the gap between them; 
then identifying the initiatives required to fill these gaps. In 
step 322, enablers and barriers to organizational transfor- 
mation are identified and a case for implementation is built. 
This is accomplished through an assessment of the current 
organizational environment and future organizational aspi- 
rations, identifying the gaps between these two, and identi- 
fying a course of action to close those gaps. 

[0095] Referring to FIG. 3C, the next task in step 320 is 
to design an organization infrastructure, step 323, to create 
structures established to form individuals into the desired 
performing organization. The organization infrastructure's 
goal is to allow workers to effectively accomplish their tasks 
within the business process so that an overall goal is met. In 
step 323, the organization will design a competency model 
and design roles, jobs, teams and organizational structures. 
The competency model definition will document the knowl- 
edge, skills and other attributes/abilities associated with high 
performance on a job. The roles, jobs, teams and organiza- 



tional structures will document the responsibilities associ- 
ated with: the individual (roles), groups of related roles 
(obs), groups of jobs (teams) and the span of control, 
reporting relationships and functional relationships of all of 
these components. Step 323 has two subtasks — to design a 
competency model, step 324, and to design roles, jobs, 
teams and an organization structure, step 325. Steps 324-325 
may be conducted iteratively and/or concurrently. In design- 
ing a competency model in step 324, the organization should 
group together related competencies to form a competency 
model. A competency is a cluster of related knowledge, 
skills, and other attributes/abilities associated with high 
performance on a job; and a competency model is a group 
of related competencies required to perform a career field 
such as team leader or technical coach. Similarly, during the 
process of designing an organization structure in step 325, 
the organization defines the roles played by individuals, the 
jobs they hold, the teams in which they work, and the 
relationship between teams. The organization should logi- 
cally define roles for individuals on the basis of their 
competencies, as decide in step 324. 
[0096] Returning to FIG. 3C, the next task in step 320 is 
to verify and validate an organization structure, step 326. In 
step 326, all components of the newly defined organizational 
infrastructure and reviewed to verify and validate that they 
meet the needs and goals of the organization. Specifically, 
the organization should verify and validate that any new 
organization design meets the needs of the business and is 
internally consistent. The organization should further con- 
firm the new organization design with any subject matter 
experts and initiative sponsors. Continuing with step 326, 
the organization should organize review sessions to validate 
how well the components of the new organization design 
(roles, jobs, teams, organization infrastructure, performance 
management infrastructure) fit together to support new ini- 
tiatives. 

[0097] The next task in step 320, as illustrated in FIG. 3C, 
is to design a performance management infrastructure, step 
327. In step 327, the organization's performance measure- 
ment scorecard is developed based on the organization's 
strategic objectives. This scorecard is then used to measure 
the organization's performance. Note that this task assumes 
that the organization has a Human Resource Organization 
with the skills to design and implement a performance 
measurement scorecard, and that the organization has expe- 
rience in organizational performance management. Thus, in 
step 327, the organization defines a means for assessing, 
rewarding, and developing the individuals in an organiza- 
tion. The performance management infrastructure has four 
components: (1) designing the performance management 
approach; (2) designing the performance appraisal instru- 
ments; (3) designing career progression; and (4) designing 
the compensation and reward structure. Overall, the orga- 
nization should establish a system to reward individuals for 
desired contributions. 

[0098] The final task in step 320 is to determine an 
organization infrastructure mobilization approach, step 328, 
as illustrated in FIG. 3C. In step 328, the organization 
determines and mobilizes the resources required to staff the 
new organization infrastructure established in step 323. The 
organization may determine profiles for the ideal candidates, 
determine sizing and timing needs, and determine a sourcing 
approach. For instance, candidates may be profiled to fit job 
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descriptions, the organizations new size may be determined 
and an approach to sourcing and staffing jobs may be 
finalized and executed. 

[0099] Returning to FIG. 3A, the next process in the 
personnel stage 300 is to design and deploy training, step 
330. In step 33, the training needs of the organization are 
analyzed and a Training Plan is created, training is designed, 
developed and deliverer and post implementation support is 
provided. The organization performs step 330 to plan activi- 
ties related to training employees. The design and deploy- 
ment of training during step 330 is illustrated in greater 
detail in FIG. 3D. As illustrated in FIG. 3D, the first task in 
step 330 is to conduct a training needs analysis, step 331, 
during which the organization identifies, by name, the par- 
ticipants to be trained, along with the courses and modules 
on which these participants will be trained. In step 331, 
target audiences and participants are identified, and training 
courses and modules are planned. The training needs analy- 
sis in step 331 may be conducted in two phases. During the 
first phase, the organization gathers the high-level training 
needs for the organization. Similarly, the second phase 
consists of gathering the detailed training needs for the 
organization. 

[0100] Returning to FIG. 3D, the next task in FIG. 3D is 
to develop a training plan, step 332, as needed, to describe 
the organization's overall training approach. In step 332, the 
overall organizational approach to training is documented. 
The training plan formed in step 332 may include any of 
following sections/topics: Objectives; assumptions: overall 
training approach; training courses, modules, and topics; 
training timeline; training logistics: and training evaluation. 

[0101] The next task in step 330, as illustrated in FIG. 3D, 
is to design training, step 333. In step 333, the training 
standards, templates, instructor and participant guides and 
the actual layout/format of training are developed. Specifi- 
cally, the organization may develop the layout/format for the 
training materials. The development includes developing 
training development standards as well as templates for any 
instructor and participant guides. 

[0102] Similarly, the next task in step 330, as illustrated in 
FIG. 3D, is to develop training, step 334. In step 334, course 
content is created using the materials compiled during the 
training design step 333. The organization may implement 
step 334 by creating the course content using the training 
development standards and instructor and participant guides. 
Other material created in step 334 may include "Train-the- 
Trainer" materials, visuals, job aids/handouts, and tracking 
documents. Using the training materials developed during 
step 334, the organization may deliver training, step 335, 
such as a Train-the-Trainer session, a pilot training session, 
and the actual training. 

[0103] Returning to FIG. 3D, the next task in step 330 is 
to provide post-implementation support, step 336. In par- 
ticular, during step 336, the organization should provide a 
short-term dedicated staff (e.g., one or two weeks) to support 
the users in applying what they've learned on the job. 
Furthermore, the support staff should be available to answer 
questions, identify and troubleshoot issues, and share best 

[0104] Throughout steps 200 and 300, as well as other 
steps in the CMM in a Box Method 10, the organization may 



need to commit to one or more actions (not illustrated) as 
required to achieve higher maturity levels in the CMM or the 
CMMI. Commit points are major decisions regarding report- 
ing the progress of present work and obtaining authorization 
to continue. Commit points define the boundaries of each 
stage around key decisions related to content, context and 
course of action. For instance, a commit point may be 
implemented prior to the executing and design of an orga- 
nization infrastructure in step 320, to require that the design 
of the new organization structure must be approved before 
further implementation can proceed. 

Program Management 

[0105] Returning to FIG. 1, a second primary component 
of the CMM in a BOX method 10 of the present invention 
is program management step 400. Program management 
step 400 generally concerns activities directly related to the 
creation and refinement of a program for implementing the 
CMM in a BOX method 10. Specifically, program manage- 
ment 400 focuses on the continuous oversight needed to 
support the delivery of a business solution through multiple 
projects and releases. Appropriate disciplines, techniques, 
and tools are used in step 400 to plan and organize the work, 
and to manage the incremental delivery of the new business 
solution. As illustrated in FIG. 4A, the program manage- 
ment stage 400 generally comprises the steps of justifying 
the program (step 410); planning the program execution 
(step 420); organizing program resources (step 430); con- 
trolling program work (step 440); and completing the pro- 
gram (step 450). These individual steps are now described in 
greater detail. 

[0106] As depicted in FIG. 4A, the organization may first 
justify the program, step 410. In step 410, a Program 
Business Case is prepared. The program business case 
approach is referenced to develop the business case. The 
business case is designed to secure stakeholder support for 
the program. Topics of the business case include the pro- 
gram's understanding of the current problem, the proposed 
solution to the problem that is to be implemented by the 
program, and a cost/benefit analysis. Justification of the 
program to all key stakeholders and sponsors helps in the 
successful execution, implementation and completion of the 
program. The program business case should provide eco- 
nomic justification for the change journey and for each 
program within the change journey. The program business 
case generally explains why the sponsoring organization 
should change, what value it receives by changing, and what 
steps are necessary for a successful change. The program 
business case addresses three main components, including 
business context and change imperatives, value impact 
analysis, and change journey. The tasks in the justification of 
the program in step are generally illustrated in FIG. 4B. 
[0107] Referring to FIG. 4B, the organization first deter- 
mines an economic evaluation approach, step 411, to obtain 
a "buy in" from the appropriate stakeholders in the spon- 
soring organization on the overall implementation approach 
for the program. Specifically, the organization tries to dem- 
onstrate the tangible benefits of a program to the affected 
parties. Step 411 attempts to show the process of imple- 
menting the program as an investment with positive, long- 
term benefits. 

[0108] Returning to FIG. 4B, the next task in step 410 is 
to create a model structure, step 412. In step 412, the 
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organization obtains internal agreement regarding the struc- 
ture of the model used to determine the benefits of imple- 
menting the program. For example, benefits to be derived 
may be expressed in terms of increased market share or 
reduced operating costs. In this way, affected parties may 
communicate the program's effects in terms of similar 
measures of costs and benefits. As suggested in FIG. 4B, the 
organization may also attempt to justify the program by 
forecasting baseline business performance, step 413. In 
other words, the organization may attempt to determine how 
the organization and its comprising units would perform 
without implementing the program. Continuing with FIG. 
4B, another task in step 410 is to project net change journey 
benefits, step 414. The organization performs step 414 to 
predict and quantify the benefits that will be derived from 
implementing the program. 

[0109] The next step in step 410 is to assemble a business 
case, step 415, using the results assembled during steps 
411-14. The organization may perform step 415 to document 
rationale for implementing the program. Ultimately, this 
documentation may serve as a motivational tool for change 
within the organization. 

[011 0] Returning to FIG. 4 A, the next task in the program 
management stage 400 is to plan the program execution, step 
420. During step 420, the organization develops plans for the 
program itself, financial management and resource manage- 
ment. Program approaches are referenced during the cre- 
ation of these documents. These plans guide the continued 
implementation of the program and are what the program 
will monitor itself against during later tasks. The individual 
tasks of step 420 are illustrated in FIG. 4C. In step 420, the 
organization may develop a consolidated program plan, 
which documents the necessary tasks, effort, schedule, and 
costs for all releases of a business capability. The organiza- 
tion may also refine a program statement of work, and 
develop bottom-up project plans. Subsequently, the organi- 
zation reconciles these plans with the top-down plans to 
generate a program baseline. The organization may have 
performed step 420 initially during program planning, in 
conjunction with or prior to the analysis stage 700 described 
below. Then, step 420 may be reinitiated during the course 
of the program as replanning is required by program man- 
agement. 

[0111] Looking at FIG. 4C, the first task of the plan 
program execution in step 420 is to plan program processes, 
step 422. The organization may specifically determine all the 
management processes necessary to support the program. 
These relate to resources, vendors, quality, configuration, 
releases, issues, problems, risk, finances, contingency, and 
performance reporting. The organization may establish and 
document goals and metrics for each management process. 
The organization should begin this task package at the start 
of the program, and refine the management processes as the 
program progresses. The organization may perform this 
initial planning at the program level to help ensure that there 
are no gaps or overlaps of activities. While all the activities 
within the Delivering phase may be required for a particular 
business capability, it is unlikely that all of the activities 
should fall within the scope of a single project team. If the 
initial distribution of the activities to project type is done at 
the program level, the risk of missing or duplicate activities 
is limited. 



[0112] Returning to FIG. 4C, the next step in the plan 
program execution, step 420, is to develop a program 
budget, step 424. In step 424, the organization may establish 
a program budget that augments the cost baseline estab- 
lished in the program plan. The program budget provides the 
additional information needed by program management to 
manage the day-to-day financial affairs of the program. 
[0113] Another step in the plan program execution, step 
420, is to develop a program communications plan, step 426, 
as illustrated in FIG. 4C. In step 426, the organization may 
identify and plan messages to program personnel, key pro- 
gram executives, and other stakeholders in the program. In 
that way, step 426 addresses the communication needs 
within the program teams. 

[0114] Subsequently, the organization performs the task of 
finalizing the program plan, step 428, as depicted in FIG. 
4C. In step 428, the organization may assemble the com- 
posite program plan. The Program Plan compiles the outputs 
from the plan management process 422 with the develop- 
ment of a program plan in step 424. The organization may 
then obtain executive and other appropriate management 
understanding and approval of the fully elaborated program 
plan and its components. The organization further briefs all 
key stakeholders (i.e., executive management, and impacted 
business operations) to ensure their understanding of, and 
commitment to, the program plan. This is crucial, because 
following this task: (1) the program should be described to 
the organization, and (2) more personnel should be assigned 
to the program. The organization may then take this oppor- 
tunity to resolve any unclear or incorrect stakeholder expec- 

[0115] Returning to FIG. 4A, the next step of the program 
management 400 is to organize program resources, step 430. 
During the step 430, resource requirements are analyzed and 
aligned so as to meet program objectives. As the program 
determines its resource needs, the Program Resource 
Request is completed to obtain the resources. Organize 
Program Resources is linked closely to planning the pro- 
gram's execution and pertains to staffing of the overall 
program. Under the Plan Program Execution task, the Pro- 
gram will plan for and deal with resource questions related 
to subordinate projects. Specifically, the organization may 
generally analyze resource requirements, initiate the pro- 
curement of goods and services, obtain human and physical 
resources from participating entities, assign these resources 
to projects, and release the resources upon project comple- 
tion. The organization may perform step 430 throughout the 
life of the program created and implemented in step 400. 

[0116] As illustrated in FIG. 4D, in order to obtain and 
deploy resources, the organization may analyze resource 
requirements, step 432. This task analyzes resource require- 
ments as defined in a program management resource plan. 
Resource requirements are consolidated from project needs 
and should generally include desired resource provider 
(generally the organization itself), if previously determined, 
resource skill/type, and time period (such as monthly). 
Continuing with step 432, the organization may create a 
program resource management plan that forecasts resource 
needs by stage and capability release. 

[0117] Returning to FIG. 4D, the organization may further 
obtain and deploy human resources, step 434. Human 
resources are obtained by initiating a request with the 
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Human Resources Organization, interviewing potential can- 
didates, and selecting the candidate that best fits the require- 
ments. Human resources are then assigned to projects as 
they arrive at the program. This task, alternatively, may be 
assigned to the projects. The program resource management 
plan may reflect actual information regarding the resource 
request. 

[0118] Returning to FIG. 4D, the organization may also 
procure and deploy physical resources, step 436. Physical 
resources are generally procured by initiating a resource 
request, evaluating the potential resources, and selecting the 
resource that best fits the requirements. Resources are then 
assigned to projects as they arrive at the program. The 
Physical Assets Inventory and the Program Resource Man- 
agement Approach are generally both updated to reflect 
actual information regarding the resource request. 
[0119] Referring again to FIG. 4D, the organization also 
releases resources, step 438. When human resources are 
assigned to projects, they receive a "roll-off' date indicating 
when these human resources are eligible for reassignment 
within or outside the program. If not reassigned inside the 
program, human resources are released to appropriate 
human resources departments for reassignment. Similarly, 
physical resource utilization is scheduled by each project, 
and these resources are returned upon completion of use. 
This process generally coincides with the completion of 
each stage of work. At that point, a determination should be 
made whether to retain or release the human and physical 
resources from the program. Al this point in process 43 0, the 
entire process 430 may repeat if there are more program 
resources to organize, decision 439. 
[0120] FIGS. 4A and 4E illustrate another step in the 
program management process, the control of program, step 
440. hi step 440, program management monitors program 
performance against program plans. Deviations from the 
plan are monitored. Corrective action is taken to resolve 
deviations as necessary. Program plans are updated to reflect 
modifications to the program. Step 440 generally provides 
leadership to guide the planning and execution of program 
work. In step 440, the organization may maintain key 
working relationships within the program, while monitoring 
and developing the skills and performance of program 
management team members. The organization may further 
identify and assess problems with program performance, 
and specify corrective actions as needed. The organization 
may evaluate program metrics to determine progress toward 
program objectives, and to determine whether or not the 
current metrics are still relevant. The organization may 
further assess whether or not the program is on track by 
reviewing program, project, and vendor performance. 
[0121] The first task of step 440 is to administer the 
program, step 441 as illustrated in FIG. 4E. An effective 
program administration results in a planned, organized, and 
managed program management office performing a wide 
range of cost-effective activities. As required, the teamwork 
environment requirements list deliverable should be updated 
to reflect relevant changes in the program. Program leaders 
should also strive to maintain a culture that encourages 
program participants to achieve maximum results. Program 
leaders should also communicate the common program 
vision to inspire others to support program goals. 
[0122] A second task in step 440 is to report performance, 
step 442, as illustrated in FIG. 4E. The organization may 



process and prepare reports for cost/schedule and other 
performance data (e.g., quality, risk, resource, etc.). This 
should involve a standard set of reports as defined in the 
program performance reporting approach section of the 
program plan. Any ad hoc reports requested by program 
management may also be prepared. 

[0123] Returning to FIG. 4E, another task in step 440 is 
to perform financial management, step 443. Specifically, the 
organization may report, monitor, and account for the pro- 
gram's financial performance and results by performing the 
financial management functions as specified in the Program 
Financial Management Approach section of the Program 
Plan. Similarly, in step 444, the maintenance of administra- 
tive policies and standards, the organization may update and 
refine the administrative policies and standards on the basis 
of their effectiveness and the evolving needs of the program, 
as illustrated in FIG. 4E. The organization should further 
communicate the changes to the program team members. 

[0124] Returning to FIG. 4E, the next task in step 440 is 
to conduct, as necessary, ongoing program orientation and 
training, step 445. In step 445, the organization may conduct 
periodic orientation and training sessions as new members 
join the program, as new types of training are required, and 
as team members need additional career development oppor- 
tunities. Likewise, in step 446, the organization monitors a 
program communications plan to help to ensure that the 
appropriate groups accomplish their responsibilities. The 
program management office itself may also be responsible 
for performing some of the activities as directed in the 
program communications plan. 

[0125] In another group of steps illustrated in FIG. 4F. the 
organization may complete the program, step 450. In step 
450, a program closeout report is prepared along with other 
program closeout documentation. The program is demobi- 
lized and responsibility for the program is transferred to the 
necessary parties. The organization achieves an orderly and 
successful program closure by formally transferring respon- 
sibility for the solution components to the operational units, 
obtaining formal management acceptance of the competitive 
solutions delivered, releasing the remaining human and 
physical resources to their providing organizations/owners, 
and completing a disposition of all program documentation 
and other materials. 

[0126] As illustrated in FIG. 4F, one step in the complet- 
ing the product is to complete documentation, step 452. The 
activities needed to complete all program documentation 
include preparing any final documentation needed to close 
the program, including final cost, performance reports, etc. 
Additionally, a final review of the documentation is per- 
formed in step 452 to ensure that it is complete and conforms 
to program standards. The organization should also identify 
materials that should be shared across the organization, 
especially process improvements, methodologies, tech- 
niques, estimating models, and reusable components. The 
organization should also take steps to ensure that the mate- 
rials are included in the appropriate repositories. The pro- 
gram documentation and other materials are transferred to 
any appropriate locations. Key deliverables are sent to the 
software engineering process group team, as determined. A 
summary of the program's final disposition, assets, records, 
and other appropriate, relevant information should be con- 
tained in the program closeout report deliverable. 
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[0127] Continuing with FIG. 4F, another step in the 
completion of the product is to transfer program responsi- 
bility, step 454. This activity transfers responsibility for the 
business capability to the appropriate organizational imit(s). 
Responsibility is assumed by the organizational units 
responsible for the continuing operation, maintenance, and 
use of the business capability and its underlying compo- 

[0128] Returning to FIG. 4F, another step in the comple- 
tion of the product is to demobilize the program, step 456. 
The resources to be released include the remaining program 
participants and all facilities (including furniture and equip- 
ment). The human resources are returned to the organiza- 
tional units that provided them. The physical resources are 
released or returned to their owners. Any remaining pro- 
curement agreements (purchase orders, contracts, leases, 
rental agreements, etc.) are closed out. 
Project Management 

[0129] Returning to FIG. 1, the CMM in a BOX method 
10 generally calls for the organizations to concurrently 
perform project management 500 with the program man- 
agement 400. The project management 500 is generally 
depicted in FIGS. 5A-50. Project management 500 gener- 
ally concerns activities and structures directly related to the 
creation and refinement of a project or product for sale. 
Project management 500 controls the delivery of the specific 
components from which a business solution is derived 
through the balanced management of Scope, Quality, Effort, 
Risk and Timeline (SQERT). Project management 500 
focuses on making critical decisions and managing risk that 
will ensure the delivery of the promised scope, on time and 
within budget at the agreed-upon levels of quality. When a 
program management function exists, project management 
works closely with program management to execute the 
SQERT activities in relation to the delivery of multiple 
projects under one overall program. As illustrated in FIG. 
5A, project management 500 generally includes planning of 
project execution (step 510); organization of project 
resources (step 520); control project work (step 530); 
completion of the project (step 540); an SQA review execu- 
tion (step 550); and supplier agreement management (step 
560). 

[0130] FIG. 5B presents the individual tasks required in 
the planning of project execution, step 510. The organization 
may perform this task package 510 at project initiation to 
define pieces of the initial Project Plan and subordinate plans 
that should be used to manage the execution of the project. 
The tasks associated with Plan Project Execution, such as 
planning and estimating, are performed throughout the 
project lifecycle at predefined decision points, and whenever 
replanning is required. During the planning of project execu- 
tion in step 510, the organization may tailor the process, step 
512, to suit a project's needs by using known tools or means. 
The organization may further request a waiver for any 
required steps that should not be followed on the particular 

[0131] The organization may further implement the plan- 
ning of project execution, step 510 through the development 
of a project plan, step 514, as illustrated in FIG. 5B. The 
organization may perform this task using a template to 
customize a specific project. The project plan describes the 
project approach for the project timetable, metrics, organi- 



zation, supplier agreement management, communication 
and sponsorship strategy, training, quality initiatives, soft- 
ware system development process, configuration manage- 
ment, logistics, facilities, tools, and purchasing. The project 
plan also describes the project approach for training, metrics 
tracking, and roles and responsibilities on the project. The 
organization may further use a best practices matrix, a 
metrics plan, a DAR reference document, and a training 
needs matrix to develop the project plan, as defined in the 
CMML Hie DAR reference document describes the formal 
DAR process and provides guidelines for identifying DAR 
triggers, setting thresholds, and selecting the best tech- 
niques. This information should be used to complete the 
quality program section of the project plan. The metrics plan 
generally contains the list of required and recommended 
metrics that a project should include in the project plan. 
[0132] The planning of project execution, step 510, con- 
tinues in FIG. 5B with the development of subordinate 
plans, step 516. In step 516, the organization may develop 
the appropriate subordinate plans to satisfy the needs of the 
project. For instance, the organization may define, as 
needed, subordinate plans for subcontractor management, 
risk management, communication and sponsorship, and con- 
figuration management. All projects require the creation of 
a work plan, and an organization may create a bottom-up or 
task-level project work plan based upon estimates. Critical 
paths and dependencies are defined and managed within the 
project work-planning tool, such as the Microsoft Project 
and Project Workbench®. 

[0133] Returning to FIG. 5B, the next step in plan project 
execution 510 is to develop project estimates, step 518. The 
development of project estimates in step 518 is analogous to 
the development of project estimates in step 218, as 
described above in FIG. 2B. Specifically, the organization 
may develop project estimates, step 518, using an estimating 
tool as a starting point for the estimates. For instance, 
estimates may be developed using file following steps: (1) 
tailor tasks and estimating model; (2) determine estimating 
factor values; (3) define work packages; (4) determine a 
timeline for the estimate; (5) reconcile a present estimate to 
an initial estimate; and (6) document assumptions used to 
form the estimates. The organization preferably further 
validates any estimates by verifying estimates against esti- 
mates or actual results from comparable projects. To form 
accurate estimates of available resources, the organization 
should further consider other resource-tapping activities, 
such as community involvement, recruiting, mentoring, and 
training, when evaluating resources. 
[0134] Another step of the project management 500 is to 
organize project resources, step 520, as illustrated in FIG. 
5C. The organizing of project resources in step 520, as well 
as in substeps 521-25, are analogous to steps 220-25, 
described above in FIG. 2C. The organization can perform 
these tasks as needed to organize the project's human 
resources, establish other resources, to make work assign- 
ments, and to develop training enabling resources. In step 
520, the project focuses on obtaining, assigning and training 
its human resources and establishing the project's other 
resources. This task is performed iteratively as needed to 
organize, mobilize and manage project resources throughout 
the execution of the project. 

[0135] Turning to FIG. 5C, the first step in organizing the 
project resources in step 520 is to refine resource needs, step 
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521. In this step 521, the organization defines the team 
organization structure, schedules the work, and defines the 
human and physical resource needs of the project. These 
tasks are performed in view of each project's requirements. 
By refining resource needs in step 521, the organization 
helps to ensure that project staffing and facilities needs are 
met on a timely basis without affecting the completion date 
and the quality of the work. The organization may complete 
this refining of resource needs in step 521 by (1) determining 
project organization structure; (2) balancing a development 
schedule using human resource guidelines; and (3) refining 
physical resource needs that were outlined in the logistics, 
facilities, and tools section of the project plan formed in step 
210. 

[0136] Returning to FIG. 5C, the organization continues 
the organization of the process resources in step 520 by 
establishing project standards and goals, step 522. The 
establishment of project standards and goals in step 522 is 
accomplished by developing, modifying, and adopting 
administrative and project-specific project standards and 
procedures. Examples of administrative procedures are 
employee availability checklists, time accounting proce- 
dures, status reporting, vacation scheduling, etc. Project 
standards and procedures include design and development 
standards, and the use of project-specific tools. The estab- 
lishment of these standards and procedures preferably 
improves the organization's communication, operating effi- 
ciency, and overall control of the project. 

[0137] The organization continues the step of organizing 
the process resources, step 520, through organizing a project 
team in step 523, as also illustrated in FIG. 5C. The 
selection of project team members is based on project 
requirements. Other elements in the organization of a project 
team are the finalization of the project team's organization 
structure and documentation in the organization chart of the 
project plan. The organization should further update a train- 
ing needs matrix to document (1) the training required of 
each project team member and (2) the proposed means for 
fulfilling the training. This document is used to track project 
team member training. In another implementation, organiz- 
ing a project team in step 523 further requires the organi- 
zation to determine, as a team, the project's mission, vision, 
and charter, and then to document these determinations in a 
project plan and orientation binder that is created as required 
for the CMM. 

[0138] Returning to FIG. 5C, another task in the organi- 
zation of project resources in step 520 is to establish other 
resources, step 524. Specifically, the organization performs 
this task to organize the physical resources, such as hard- 
ware or software, provided by program management and to 
develop the orientation and/or training needed to support the 
activities of the project team. The establishment of other 
resources in step 524 helps create a work environment that 
promotes communication, collaboration, and group cohe- 
sion. 

[0139] Also as illustrated in FIG. 5C, the organization of 
project resources in process 520 further includes enabling 
resources, step 525. Organizations perform this step to orient 
and train team members, manage the physical resources 
assigned to the project, and coach and evaluate team mem- 
bers. The enabling of resources in step 525 aids the project 
manager in motivating and challenging team members and 



while helping to ensure that various project personnel 
believe their work to be important. Specifically, the organi- 
zation should communicate the project's mission, vision, 
and charter to new team members. Large projects may also 
elect to formalize these items at the program level, and 
projects may conduct one or more meetings that include all 
team workers. 

[0140] As illustrated in FIG. 5D, another step in the 
project management 500 is to control project work, step 530. 
In step 530, project management monitors the execution of 
the project against project plans and makes adjustments as 
necessary. Project Status Reports are prepared for the Project 
Sponsor. Potential and actual problems are identified 
through the measuring and monitoring of progress and 
performance against the Project Plan. Depending on the type 
of problem identified, an Issue, Risk, SIR or CR is logged. 
Project management is expected to take appropriate correc- 
tive actions to resolve problems that are discovered. Step 
530 and constituting tasks 531-37 closely correlate, respec- 
tively, to steps 230-37, described in FIG. 2D and its accom- 
panying text. The organization performs step 530 to control 
project execution throughout the project's life cycle. The 
control of project work in step 530 includes identifying 
potential and actual problems by monitoring and measuring 
progress against the project plan. 

[0141] As illustrated in FIG. 5D, the controlling of project 
work in step 530 begins with the releasing of work packages, 
step 531. To release work packages, the organization should 
assemble and release work packages according to the work 
plan, and communicate their requirements to the assigned 
team members. Work packages are generally described in 
the CMM criteria and generally relate to the task and 
functions given to the various workers in a project. The 
project team then performs the work needed to develop the 
required deliverable good. During step 531, the organization 
preferably acts to ensure that each team member understands 
assigned responsibilities, including target dates and budgets. 
Furthermore, the organization should encourage each team 
member to provide input regarding various assigned respon- 
sibilities, including target dates and budgets, and to accept 
and carry out these assigned responsibilities. 

[0142] As depicted in FIG. 5D, a following step in the 
control project work, step 530, is measuring performance, 
step 532. The measuring of performance in step 532 gener- 
ally includes capturing actual results and calculation of 
metrics in order to manage performance. Capture metrics, as 
outlined in the organization metrics plan formed in step 510, 
include cost, effort, scope, quality, and schedule. The orga- 
nization should further track project infrastructure/technical 
requirements, such as hardware, software, and performance 
requirements, that were outlined during planning in step 
510. The organization should also analyze any deviations 
from the project plan and identify, in a timely maimer, the 
causes for the deviations. 

[0143] Concurrent with the measuring of performance in 
step 532 is managing performance, step 533, as illustrated in 
FIG. 5D. Managing performance in step 533 generally 
requires the organization to manage project performance 
against the previously defined project and work plans. To 
project performance in view of the project and work plans, 
tire organization proactively assesses performance, status, 
quality, and risk. When the actual results from the develop- 
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ment of the project do not match the plans, the organization 
should further determine alternative goals or actions. The 
implementing organization may further obtain approval for 
corrective actions, and then take corrective actions. The 
corrective actions may include, but are not limited to, work 
process changes, team building, training, increased or 
decreased supervision, work assignment changes, reassign- 
ment of team members, initiation of risk responses, the 
change of requests to be pursued with program management 
as part of the configuration management process, project 
replanning changes that specify needed modifications to the 
project plan, project plan revisions (work package changes, 
etc.) or escalation to program management. The organiza- 
tion should also reevaluate project decisions throughout the 
project life cycle, when project triggers or other issues, risks, 
etc. arise. In step 533, the organization may also manage 
team member performance according to organizational stan- 
dards and tools. 

[0144] Continuing with FIG. 5D, following the measuring 
of performance in step 532 and the managing of perfor- 
mance in step 533, the organization communicates project 
status, step 534. During (he step 534, the organization 
generally develops and communicates project status to all 
project stakeholders according to the Project Plan. The 
project stakeholders include project and senior management 
and other affected groups. The organization further conducts 
status and review meetings involving affected groups as 
appropriate. During the communication of project status in 
step 534, the organization should document meeting minutes 
as required for the CMM. 

[0145] Continuing with FIG. 5D, following the commu- 
nication of project status in step 534, the organization 
obtains acceptance of interim deliverable goods, step 535. 
Obtaining acceptance of interim deliverable goods in step 
535 generally requires that the organization obtain accep- 
tance of interim deliverables by all designated stakeholders, 
as appropriate, at key interim points throughout the project 
life cycle. Any acceptance of final deliverables takes place 
in connection with completing the program. 

[0146] Another task in the control of project work in step 
530 is to execute project management processes, step 536. 
The organization should execute these processes in conjunc- 
tion with other project control activities, such as measure- 
ment activities and status reporting. Also, the project man- 
agement processes may occur continuously, periodically, or 
may be event driven. One project management process in 
step 536 is risk management, which addresses the identifi- 
cation, analysis, and avoidance/mitigation aspects of risk 
management on a project. One project management process 
is risk identification, during which the organization identi- 
fies, names, and describes the various risks. The organiza- 
tion should further generate a list of specific incremental 
risks in the project's risk-tracking tool. The organization 
documents known triggers for a risk, the potential damage 
for each risk item, and references for the sources of risk. 
Another risk management task in step 536 is risk analysis, 
in which the organization analyzes the identified risks. In 
risk analysis, the organization should classify the risks and 
include any additional information necessary to support the 
analysis. The organization may then select a rank/prioritized 
list of top risks. For instance, the organization may create a 
list of the top five risks to a project. Another risk manage- 
ment task is risk avoidance and mitigation. Risk avoidance 



activities address the sources of a risk, thereby reducing the 
probability that it should become a problem. For a top- 
ranked/prioritized risk, the orgamzation should identify how 
the risk can be avoided. Risk mitigation measures attack the 
consequences of a risk, reducing the risk's potential impact 
on the project. For the top-ranked/prioritized risks, the 
organization may identify actions to reduce the impact of the 
risk if it occurs. The organization may also use DAR to 
assess the risks. 

[0147] Another project management process hi the execu- 
tion of project management processes in step 536 is scope 
management, which addresses the acceptance of require- 
ments to define scope and the requirements of change 
control process. For instance, one scope management task is 
requirements development. During the task of requirements 
development, the organization identifies and documents 
requirements needed to promote and ensure bi-directional 
traceability, so that the organization may trace requirements 
between the development and the testing of the require- 
ments. As with all work products, requirements are prefer- 
ably placed under configuration management (CM), as 
defined in the CMMI. Another scope management task is 
requirements acceptance, during which the organization 
documents and reviews requirements with all affected 
groups and obtains acceptance from the affected stakehold- 
ers. The organization should further establish baseline stan- 
dards for satisfying the requirements. Another scope man- 
agement task for the organization is to make any required 
changes to the requirements and their baselines. The orga- 
nization generally follows the project's change control pro- 
cess for any changes to baselined requirements. Specifically, 
the organization submits a change request; reviews a change 
request; performs impact analysis, including cost, schedule, 
and efforts impacts; determines disposition; implements 
change, including associated impact to other work products 
and activities; and notifies requester and affected groups. 
Again, the organization may determine if it is necessary lo 
use DAR to assess changes in scope. 
[0148] Another project management process in step 536 in 
the execution of the project management processes is con- 
figuration management. This task addresses the set of activi- 
ties performed to establish and maintain the integrity of the 
project work products throughout the project's life cycle. 
One set of configuration management tasks relates to con- 
figuration identification activities. During the configuration 
identification activities, the organization identifies, names, 
and describes each of the configuration items that should be 
placed under configuration management. In particular, all 
work products should be placed under some type of con- 
figuration management. During the configuration identifica- 
tion activities, the organization generally uses the CM plan 
to define a baseline for the configuration items and to 
indicate the level of configuration management for each 
item. Another configuration management process in step 536 
is configuration of control activities. Generally, the organi- 
zation requests, evaluates, approves or disapproves, and 
implements changes to the baselined configuration items 
defined during the configuration identification activities. All 
of the configuration items should be archived and placed 
under the project's documented change control process. 
Configuration of status accounting activities is another con- 
figuration management process in step 536. During this 
process, the organization records and reports the status of the 
project s configuration items using a configuration manage- 



US 2006/0235732 Al 



18 



Oct. 19, 2006 



ment status report. Similarly, the organization should further 
perform configuration audits. Specifically, the organization 
may, using the CM plan, determine the extent to which 
actual configuration items reflect the planned configuration 
items. The purpose of this task is to ensure that the entire 
configuration is correct and complete. The organization 
should further document results as required in die CMMI, 
using a configuration audit. 

[0149] Another project management process of the execu- 
tion of the project management process in step 536 is issue 
management and escalation. This task involves the identi- 
fication and documentation of issues using an issue tracking 
tool, as well as a review of the issue and an analysis of any 
impact on deliverables, scope, contingency, resources, costs, 
schedule, and/or quality. Specifically, the organization 
should identify a resolution approval party, an issue's owner, 
and determine expected time frames. The organization may 
also determine if it is necessary to use DAR to assess the 
issue, as described above. The organization may further 
research and identify issue solution alternatives. Subse- 
quently, the organization may refer the issue to program/ 
senior management when: (1) the project manager cannot 
resolve the issue internally, (2) when the issue impedes the 
progress of a project, and when the issue is beyond the 
authority of the project manager to resolve. These are 
generally issues that (1) cannot be resolved within a project 
team, (2) are resolvable with action items, (3) can be 
escalated to the next level, (4) are reactively discovered 
during the course of development, (5) affect program/project 
scope, costs, schedule, projected busii e c 1 nee i 
high-level design, (6) affect multiple projects or releases, 
and/or (7) involve groups outside the project that affect 
project delivery. The organization should accordingly mom- 
tor issues status while approving or rejecting resolutions. At 
the same time, the organization should communicate reso- 
lutions to stakeholders and affected parties and take correc- 
tive action as described above in the context related to 
management of performance tasks. 

[0150] Returning to FIG. 5D, another step during the 
process of controlling the project work in step 530 is to 
update the project plan and subordinate plans, step 537. In 
particular, throughout the life cycle of the project, the project 
plan and subordinate plans (Risk Management, Configura- 
tion Management, Work Plan, Subcontractor Management 
Plan, Community, and Sponsorship Plan) should be updated 
as appropriate, by the organization to reflect any changes on 
the project that should affect the content of the documenta- 

[0151] Another step of project management 500 is to 
complete the project, step 540, as illustrated in FIG. 5E. In 
step 540, project closeout is performed and overall project 
results are evaluated. Project Management verifies that all 
activities for a project are complete so that all resources can 
be released and all documentation and responsibilities can 
be transferred to the necessary parties. In this way, step 540 
enables Project Management and the Project Sponsor to 
measure the success of the project and use results of the 
project as inputs to future efforts. A first step in completing 
the project in step 540 is to obtain a formal acceptance of 
deliverable(s), step 541, and this task 541 entails obtaining 
sign-offs on the final deliverables from the appropriate 
stakeholders, hi effect, each stakeholder should agree that 
the project is, in fact, complete. Another step in completing 



the project during step 540 is the preparation of final 
documentation, step 542, in which the organization com- 
pletes final revisions and packaging of deliverables. Like- 
wise, the organization furthers the completion of the project 
in step 540 by transferring responsibility for deliverables, 
step 543, to formally transition responsibility for the deliv- 
erables to the appropriate parties. The transfer of responsi- 
bility for deliverables in step 543 generally includes the 
transition of training materials, operations manuals, and 
other supporting documents. 

[0152] Continuing with the completion of the project in 
step 540, the organization evaluates the project, in step 544, 
by assessing the success of the project, summarizing the 
project's accomplishments, discussing/documenting any 
items for improvement, and channeling the resulting infor- 
mation through the appropriate quality management process. 
The various results of the evaluation of the projects in step 
544 should be recorded in a closing memo, as specified in 
the CMMI. The results of the evaluation may include (1) 
reviewing the project work plan; (2) updating the estimates; 
(3) sending the project's actual results to the owners of the 
estimating tool; (4) submitting final project metrics to the 
Software Engineering Process Group (SEPG); and (5) con- 
ducting an SQA debriefing to discuss results of the SQA 
program and also process improvement points. Another step 
in the completion of the project, step 540, is to release 
resources, step 545. The organization performs step 545, for 
instance, to "roll off" human resources from the project and 
to return equipment and supplies to the appropriate custo- 
dian, thereby freeing these resources for use on other 
projects. 

[0153] Returning to FIG. 5 A, the next task in the project 
management 500 is software quality assurance (SQA) 
review execution, step 550, the substeps of which are 
illustrated in FIG. 5F. During the SQA review execution of 
step 550, the organization may conduct software process and 
work product quality assurance reviews to verify project 
adherence to standards and procedures. The first step of the 
SQA review execution 550 is to complete a project plan and 
metrics workbook, step 551 . In this way, the project manager 
and SEPG liaison are encouraged and required to identify 
deliverables and processes to be reviewed; ensure that 
deliverables in the Project Plan and Work Plan are consis- 
tent; identify reviewers, reviewees, and review criteria; 
identify roles and responsibilities; identify SQA metrics; 
complete the quality program section of the project plan; and 
update the metrics workbook with the SQAreview schedule. 

[0154] Another step of the SQA review execution 550 is to 
prepare for an SQAreview, step 552. In the SQAreview, the 
project manager provides job accounting information to the 
SQA reviewer and sets SQA review expectations. In prepa- 
ration for the SQA review during step 552, a deliverable 
owner (i.e., a party responsible for producing a deliverable 
product or service) provides the deliverable to be reviewed, 
where "deliverable" is defined in the CMMI. The deliverable 
owner further provides contact and availability information 
to the SQA reviewer and provides review criteria and 
standards to the SQA reviewer. In response, the SQA 
reviewer gathers the deliverable product or service, reviews 
the proposed review criteria and standards, schedules a 
meeting with the deliverable owner, and receives job 
accounting information from the project manager. 
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[0155] Returning to FIG. 5F, another step of the SQA 
review execution 550 is to conduct the SQA review, step 
553. During the SQA review in step 553, the SQA reviewer 
generally reviews deliverables against review criteria/stan- 
dards, identifies nonconformance items, and follows up with 
the deliverable owner as needed to meet the requirements of 
the CMMI. At the same time, a SEPG liaison reviews the 
project management deliverables against a best practices 
matrix. For the CMMI, the deliverable owner should be able 
to continue answering any questions. 

[0156] Another step of the SQA review execution 550 
illustrated in FIG. 5F is to prepare the SQA report, step 554. 
The SQA reviewer prepares a detailed summary of findings 
and recommendations, including item number, date 
reported, and an accurate description of nonconformance 
items. The SQA reviewer then distributes the SQA report to 
the deliverable owner and the SEPG liaison. The deliverable 
owner should then document responses in the SQA report 
template. 

[0157] Continuing with FIG. 5F, another step of the SQA 
review execution 550 is to discuss nonconformance items, 
step 555. Specifically, the organization should require the 
deliverable owner to discuss any nonconformance items 
with the SQA reviewer, hi addition, the deliverable owner 
updates the SQA Report with proposed resolution(s) and 
projected completion date(s) for agreed upon items. The 
deliverable owner also escalates disagreement items for 
facilitation and updates a return report, as well as any 
necessary documents to the SQA reviewer for verification. 
In response, the SQA reviewer should discuss nonconfor- 
mance items with the deliverable owner and verify the 
resolution of nonconformance items. During step 555, the 
SEPG liaison and the project management should also 
resolve escalated nonconformance items and resolve, on a 

tiling conflicts between the SQA reviewers and the deliver- 

[0158] Continuing with FIG. 5F, another step of the SQA 
review execution 550 is lo track SQA metrics, step 556. In 
step 556, the SQA reviewer sends the final report to the 
deliverable owner and the SEPG liaison. At this point, the 
SEPG liaison may update an SQA tracking tool and forward 
the final report and metrics to the project sponsor and project 
manager. Typically, the SEPG liaison includes metrics such 
as the SQA schedule variance; the number of nonconfor- 
mance items; the cost/savings of the SQA program; the 
value added by conducting SQA reviews; and a best prac- 
tices percentage showing compliance with desired best 
practice policies. As required by the CMMI, the project 
manager keeps copies of documentation and reports. 

[0159] Another aspect in the project management 500 is 
supplier agreement management, step 560, which is gener- 
ally illustrated in FIG. 5G. The supplier agreement man- 
agement 560 comprises subcontractor management in step 
560(a) and product acquisition in step 560(6). Specifically, 
the subcontractor management in step 560(a) comprises the 
tasks of planning subcontractor management, step 561; 
organizing subcontractor management resources, step 562; 
controlling subcontractor management, step 563; and com- 
pleting subcontractor management, step 564, as illustrated in 
FIG. 5G. Likewise, product acquisition in step 560(6) 
comprises the tasks of planning product acquisition, step 



565; organizing product acquisition, step 566; controlling 
product acquisition, step 567; and completing product acqui- 
sition, step 568, as depicted in FIG. 5G. 

[0160] FIG. 5H depicts that tasks 561(a)-561(/) comprise 
the planning of subcontractor management in step 561. In 
step 561, project management plans for the project's use of 
subcontractors including developing criteria to be used for 
subcontractor selection. The first task in step 561 is to 
identify the need for a subcontractor, step 561(a). In step 
561(a), the organization identifies a need for a subcontractor. 
Before the need for a subcontractor is determined, the 
business requirements for the project should be defined. The 
objective is to describe "what needs to be done and/or 
achieved" and which development team/s should be instru- 
mental in implementing this requirement. The supporting 
analysis and research provide input with regard to the 
requirements, including the current capability analysis, con- 
straint analysis, best practice research, and potential delivery 
options. If the project team does not have the resources to 
satisfy these requirements, then a subcontractor should be 
considered. Again, the organization may use DAR if nec- 
essary to evaluate the need for a subcontractor. If a subcon- 
tractor is needed, the organization should update the supplier 
agreement management section of the project plan with a 
description of the subcontractor arrangement. The organi- 
zation may then prepare the subcontractor management 

[0161] Returning to FIG. 5H, the organization's next 
action during the planning of subcontractor management in 
step 561 is to define a subcontractor statement of work 
(SOW), step 561(6). The subcontractor SOW should clearly 
define the scope and objectives of the subcontract, the 
process that should be used to manage the subcontractor, and 
any standard contract clauses. The SOW should also provide 
as much detail as possible about the planned subcontract, 
including the contract monitoring process, the quality man- 
agement process, the configuration management process, 
and the contract closure process. A proposal/project team is 
generally responsible for identifying the technical require- 
ments that the subcontractor should satisfy. 

[0162] As depicted in FIG. 5H, the organization's next 
action during the planning of subcontractor management in 
step 561 is to develop subcontractor selection criteria, step 
561(c). Prior to assessing subcontractors, the organization 
should define the selection criteria. Whereas some criteria 
should be generic, such as quality, service, value, and past 
performance, there is greater value in defining specific 
criteria that apply to different categories of assets and 
services to be procured, especially those criteria concerning 
longer-term cost considerations. Selection criteria should 
also reflect defined business needs. To satisfy this step 
561(c), the proposal/project team should create the subcon- 
tractor selection criteria using the template provided. 

[0163] Next, in step 561 (d), the organization should 
develop a subcontract pricing mode. In general, after defin- 
ing the statement of work, it is necessary to establish the type 
of contract that will be used for the subcontract. It is 
important to determine the type of contract early in the 
process, as it has a fundamental impact on the subcontrac- 
tor's proposal and economics of the program. This work 
should be closely coordinated with the development of the 
contract strategy. 
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[0164] Returning to FIG. 5H, the organization's next 
action during the planning of subcontractor management in 
step 561 is to create a subcontractor long list, step 561(e). 
Using the subcontractor selection criteria template provided, 
the organization in step 561(e) identifies the long list of 
subcontractors that will be invited to propose. This list may 
be based on the following criteria: satisfaction with existing/ 
previous subcontractor work, market share of the subcon- 
tractor, industry reputation of the subcontractor, proximity 
of the subcontractor, availability of the subcontractor, finan- 
cial status of the subcontractor, etc. 

[0165] As depicted in FIG. 5H is the prepare/finalize 
request for proposal (RFP), step 561(f). The RFP should be 
created in step 561(f) after the need for a subcontractor has 
been established in step 561(a), the statement of work has 
been defined in step 561(6), the selection criteria have been 
established in step 561(e), the pricing model has been 
established in step 561(d), and the appropriate terms and 
conditions have been established. The RFP should be final- 
ized with input from all relevant stakeholders. 

[0166] As depicted in FIG. 5G, the next task in the 
supplier agreement management in step 560(a) is to orga- 
nize subcontractor management resources, step 562. The 
organization performs step 562 to organize resources asso- 
ciated with subcontract management. In step 562, the project 
Work Plan is updated to account for subcontractors. Tasks 
that will use subcontractor resources are documented. Sub- 
contractor Selection Criteria are finalized and a subcontrac- 
tor is selected. Turning now to FIG. 51. the organization of 
subcontractor management resources in step 562 comprises 
the tasks of developing work breakdown structure (WBS) 
and a resource-loaded work plan, step 562(a); finalize sub- 
contractor selection criteria, step 562(6); issue a request for 
proposal (RFP), step 562(c); receiving bids, step 562(d); 
evaluating bids to select a suitable subcontractor, step 
562(e); and negotiating and finalizing a subcontract, slep 
562(f). It should be noted that steps 562(a)-(e) in the flow 
chart in FIG. 51 represent the potential tasks that would be 
completed to select a subcontractor, but many of these steps 
may be omitted based on project requirements. 

[0167] In the development of the WBS and resource- 
loaded work plan of step 562(a), the WBS decomposes each 
business capability into manageable units and depicts the 
total scope of the solution needed to achieve the program/ 
project objectives. The work plan sets out the major work 
processes and constituent units of work that will be used to 
accomplish the project. The resource-loaded work plan then 
matches available resources with each task in the work plan. 
Both the WBS and the resource-loaded work plan should 
document the tasks that will be completed using subcon- 
tractor resources. 

[0168] In step 562(6), the organization should finalize 
subcontractor selection criteria, as depicted in FIG. 51. In 
step 562(6), the organization updates the subcontractor 
selection criteria established during the plan subcontractor 
management of step 561 to finalize the criteria that will be 
used to evaluate subcontractor proposals. Continuing with 
FIG. 51, during step 562(c), the organization next issues an 
RFP and distributes the RFP to a list of subcontractors 
identified for solicitation in step 561(e). The organization 
then receives bids, step 562(d), to gather proposals from 
subcontractors. 



[0169] The organization should then evaluate the bids and 
select a suitable subcontractor, step 562(e) in FIG. 51. In 
particular, as bids are received from subcontractors, the 
responses should be entered into a subcontractor selection 
criteria matrix to facilitate the evaluation process. Evalua- 
tors should also review the potential risks associated with 
each subcontractor. Once all responses have been entered 
into the matrix and all potential risks have been assessed, a 
selection can be made by the organization. 

[0170] The organization should next negotiate and finalize 
a subcontract, step 562(/) in FIG. 51. After the subcontractor 
is selected, it may be necessary to make additional negotia- 
tions to finalize the contract. As a result of finalizing the 
subcontract, it may be necessary to update the project plan 
and/or subcontractor management plan with any new con- 
ditions, such as the need to provide project-furnished facili- 

[0171] Returning to FIG. 5G, the next step in the subcon- 
tractor management m step 560(a) is to control subcontrac- 
tor management in step 563. In step 563, the organization 
acts during project execution to monitor and control sub- 
contractor activities for subcontractors that do not function 
as part of the project team. Subcontractors that work as part 
of the project team follow the processes outlined in the step 
of control project work in step 530. In addition, there should 
be regular status meetings with the subcontractor. During 
step 563, the work and work products of subcontractors are 
monitored through visual observation and/or Subcontractor 
Status Reports. Corrective action is taken as problems arise. 

[0172] Substeps 563(a)-(6) of the control subcontractor 
management in step 563 are depicted in FIG. 5.1. Specifi- 
cally, in step 563(a), the organization monitor subcontractor 
performance: The project manager or designated team mem- 
ber overseeing the subcontractor should observe the sub- 
contractor's performance on a regular basis and manage all 
communications with the subcontractor. If the subcontractor 
fails to perform as expected (e.g., late delivery, poor quality, 
etc.), the organization should act to remedy these failures to 
minimize their harmful effects on the project. 
[0173] Likewise, in step 563(6), the organization should 
receive subcontractor reports, as illustrated in FIG. 5J. The 
subcontractor should submit all reports to the project team as 
specified in the subcontract. This may include status reports, 
turn-around documents, invoices, metrics, etc. These reports 
should be used to track subcontractor performance against 
the work plan and schedule milestones and evaluate quality 

[0174] Returning to FIG. 5G, the final step in subcontrac- 
tor management hi step 560(a) is to complete subcontractor 
management, step 564. In step 564, project management 
verifies that the subcontractor has completed all tasks out- 
lined in the subcontract and that technical performance 
requirements are satisfied. If the subcontractor successfully 
satisfies all contract requirements, both administrative and 
technical, the contract close out process occurs. If not, 
project management takes corrective action. Project Man- 
agement updates the Closing Memo based on subcontractor 
deliverables and performance as necessary. As depicted in 
FIG. 5K, the tasks in the completion of subcontractor 
management in step 564 include the determination of 
whether contract requirements are satisfied, step 564(a); 
determining if technical performance requirements are sat- 
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isfied, step 564(6); transitioning responsibilities and work 
products, step 564(c); and closing contract, step 564(d). In 
determining if contract requirements are satisfied in step 
564(a), the organization assesses whether the subcontractor 
has failed to satisfy the contractual requirements. The orga- 
nization further determines if any corrective actions may be 
needed. 

[0175] Continuing with FIG. 5K, in determining if tech- 
nical performance requirements are satisfied in step 564(6), 
the project manager or designated team member oversees a 
subcontractor and is responsible for assessing the technical 
performance of that subcontractor. The acceptance criteria 
for contractual closeout are documented in the SOW and 
should be used to evaluate the subcontractor's performance. 
This assessment may include a review of deliverables, 
metrics, invoices, etc., submitted by the subcontractor. If the 
subcontractor fails to satisfy the technical performance 
requirements of the contract, corrective action may be 
needed. 

[0176] Referring again to FIG. 5K, the next task in 
completing the subcontractor management is the transition 
of responsibilities and work products, step 564(c): Once the 
subcontractor has successfully completed all work stated in 
the contract, it is necessary to transition the responsibilities 
and work products of the subcontractor to the appropriate 
party. Step 564(c) may require the subcontractor to train 
personnel in a given area, hand over system documentation 
and manuals, etc. 

[0177] Then, in step 564(d), the organization may close 
the contract with the subcontractor, as illustrated in FIG. 
5K. If the subcontractor successfully satisfies both admin- 
istrative and technical contract requirements, the contract 
closeout process can occur. The contract closeout process 
may include the collection of information, such as perfor- 
mance metrics, from the subcontractor if this requirement 
was specified in the statement of work, request for proposal, 
or contract. 

[0178] Returning to FIG. 5G, the corollary to the subcon- 
tractor management of step 560(a) is the product acquisition 
of step 560(6). The first task in the product acquisition is to 
plan the product acquisition in step 565. The organization 
performs step 565 to plan activities related to product 
selection and implementation. In step 565, the project's 
product needs are identified. The project's detailed approach 
to product acquisition is outlined in the Product Selection 
Approach. After determining a need for a product exists, a 
high-level review of the market is conducted to determine 
possible vendors and the product selection criteria are devel- 
oped. It should also be noted that, in some cases, there are 
outside factors that govern the selection of products. There- 
fore, the following tasks 565(a)-565(d) may not always be 
necessary or inclusive. In addition, these tasks are only 
necessary when the product will be turned over to the client. 

[0179] Turning now to FIG. 5L, the first task in the 
planning of product acquisition in step 565 is to identify a 
need for a product, step 565(a). In step 565(a), the organi- 
zation determines if business needs can be satisfied with the 
implementation of an off-the-shelf product. Step 565(a) may 
also involve participation from the proposal/project team 
and the client. The organization may generally follow the 
guidelines in a DAR Reference document. Specifically, the 
triggers and thresholds documented in the project plan 



determine if it is appropriate to use DAR to evaluate the 
need and/or selection of an off-the-shelf product. The orga- 
nization may likewise use the project plan to describe the 
project's need for an off-the-shelf product and to identify the 
areas in which it may be necessary or desirable to use an 
off-the-shelf product. 

[0180] As depicted in FIG. 5L, the next task in the 
planning product acquisition in step 565 is to develop a 
product selection approach, step 565(6). In step 565(6), the 
organization may document the project's detailed approach 
for product acquisition. Likewise, another task in the prod- 
uct acquisition 560(6) is to survey potential product provid- 
ers, step 565(c). In step 565(c), the organization may con- 
duct a high-level review of the market to determine potential 
product providers or contact an alliances group for assis- 
tance in identifying providers. The organization may then 
document potential providers on a vendor long list according 
to product selection criteria. This step 565(c) may include 
input from several different sources such as Internet 
research, participants with past project experience, indepen- 
dent product ratings, etc. In some cases, step 565(c) may not 
apply as the project sponsor may dictate the specific appli- 
cation to be used. 

[0181] Continuing with FIG. 5L, the next task in the 
planning of product acquisition in step 565 is to finalize the 
list the product providers to be invited to propose, step 
565(d). In step 565(d), the i rgani ation identifies a list of 
product providers to be considered based on the information 
gathered during the survey of potential candidates. The 
organization may select providers that satisfy most of the 
project's requirements. In step 565(d), the organization may 
refer to predetermined product selection criteria with the 
product providers to be considered. 

[0182] Continuing with FIG. 5G, the next task in the 
product acquisition step 560(6) is to organize product acqui- 
sition, step 566. In step 566, the organization organizes 
resources associated with product acquisition. Furthermore, 
the product selection criteria are finalized and vendors are 
invited to demonstrate their products. At the end of this task, 
final product selections are made. It should be noted that, in 
some cases, there are outside factors that govern the selec- 
tion of products , and, therefore, some or all of steps 565(a)- 
(e), described below in FIG. 5M, may be skipped as 
necessary. 

[0183] Turning now to FIG. 5M, the individual tasks that 
comprise the organization of the product acquisition in step 
566. The first task is to finalize product selection criteria, 
step 566(a). In step 566(a), the organization should develop 
finalized selection criteria based on the organization's eco- 
nomic needs and goals, such as costs, timeframe, and quality 
concerns. 

[0184] Next, in step 566(6), the organization may define 
business scenarios, as illustrated in FIG. 5M. Using the 
product selection criteria formed in FIG. 566(a), the orga- 
nization may develop business scenarios that may then be 
used to form a questionnaire. In this way, the business 
scenarios may be used to evaluate product fit and perfor- 
mance during vendor demonstrations. 

[0185] The next task in FIG. 5M is to prepare and 
distribute a request for proposal (RFP), step 566(c). In step 
566(c), the organization should develop a RFP that requires 
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the vendors and providers to propose similar configurations 
and have all hardware, software, and on-site consulting 
services (in days) identified and itemized. Providers can also 
submit their idea of an optimal configuration. Furthermore, 
the RFP should include as much information about appli- 
cation interaction as possible. 

[0186] Returning to FIG. 5M, another task in the organi- 
zation of product acquisition in step 566 is to conduct vendor 
demonstrations, step 566(d). In step 566(d), each finalist 
should provide a product demonstration. During the dem- 
onstration, the organization should evaluate how well each 
provider/vendor meets the various business scenarios. 
[0187] Next, the organization may compare costs and 
benefits of product providers, step 566(e), as illustrated in 
FIG. 5M. hi particular, the organization may use the product 
selection criteria to compare the proposals submitted by the 
product provider finalists. Also evaluate the potential risks 
associated with each product. 

[0188] Continuing with FIG. 5M, another step in the 
organization of the product acquisition is to make a final 
product selection, step 566(f). The organization may select 
the product provider based on the final scores in the product 
selection criteria and an assessment of potential risks. Step 
566(f) may also includes the preparation of a purchase 
agreement or contract. It may also be necessary in step 
566(/) to update the project plan to document any new 
conditions that result from the product acquisition, such as 
the need to provide project-furnished facilities. 
[0189] Returning to FIG. 5G, the next step in the product 
acquisition of step 560(6) is to control product acquisition, 
step 567. In step 567, the selected product is installed, 
testing is performed, and the performance of the product is 
evaluated. The organization may perform step 567 after 
acquiring the product to ensure that the product satisfies 
business needs and performs as anticipated. It should be 
noted that these tasks are typically performed only for new 
products that have not been previously tested and imple- 
mented. For products that have been previously imple- 
mented, application testing and performance are evaluated 
during previous product and acceptance testing. 

[0190] The substeps in the control of product acquisition 
in step 567 are depicted in FIG. 5N. The first task in 
controlling product acquisition in step 567 is to install or 
otherwise use the product in the environment to be used for 
acceptance and performance testing, step 567(a). 

[0191] Next, in step 567(6), the organization conducts 
application testing, as illustrated in FIG. 5iN. Specifically, 
once the product has been delivered, it is preferable in step 
567(6) to perform a fit analysis to ensure that the software 
satisfies the business scenarios as originally intended. The fit 
analysis should map the product characteristics against both 
the existing user service class characteristics and the existing 
underlying components of the delivery vehicles (execution, 
operations, development, computing platforms, and network 
architecture). 

[0192] Continuing with FIG. 5N, the next task in the 
control of the product acquisition is to evaluate application 
performance, step 567(c). Three different methods are avail- 
able to evaluate product performance in step 567(c): com- 
parison, application sizing, and electronic spreadsheet 
analysis. Comparison analysis may be performed using 



existing installations of the product with similar environ- 
ments, operations, and configurations. Some product ven- 
dors perform application sizing to determine if the product 
is adequate for the project needs, but results should be 
interpreted with caution. Electronic spreadsheet analysis 
translates business transactions into resource utilization and 
service times for evaluation. The accuracy of electronic 
spreadsheet analysis is driven primarily by the knowledge of 
business functions, transaction rates, and package architec- 

[0193] Returning to FIG. 5G, another step in the product 
acquisition is to complete the product acquisition, step 568, 
to close out the product acquisition tasks. In step 568, project 
management determines if the contract requirements are 
satisfied. Once the product has been assessed and meets all 
performance and functional needs, the product and the job 
responsibilities associated with the product are transitioned 
to the appropriate party. At this point, the contract with the 
vendor is closed. The tasks in the completion of the product 
acquisition in step 568 are illustrated in FIG. 50. Specifi- 
cally, the completion of the product acquisition in step 568 
comprises the tasks of detennining if contract requirements 
are satisfied, step 568(a); determining if performance issues 
require contract to be closed step 568(6); transitioning the 
acquired product, step 568(c); and closing the product 
acquisition contract, step 568(d). In the determination of 
whether purchase contract requirements are satisfied during 
step 568(a), the organization assesses the product against the 
contract requirements to determine if the agreed upon con- 
ditions have been met. Next, in step 568(6), the organization 
determines whether performance issues require the product 
purchase contract to be closed. Specifically, the organization 
decides if the product meets performance requirements. If 
the product fails to meet performance requirements, it may 
be necessary to terminate the contract. Contact the alliances 
group for assistance in identifying a product with better fit 

[0194] Once the product has been assessed and meets all 
performance and functional needs, it is necessary to transi- 
tion the product and the job responsibilities associated with 
the product to the appropriate party. Accordingly, in step 
568(c), the organization may transition the product as 
needed, as illustrated in FIG. 50. Step 568(c) may require 
the organization to train the appropriate party, handing over 
system documentation and manuals, etc. Then in step 
568(d), the organization may close the purchase contract 
after verifying that contract requirements have been satis- 
fied. 

Deliver)' Management 

[0195] Returning to FIG. 1, the next step of the CMM in 
a BOX method 10 of the present invention is to implement 
delivery management 600. Delivery management 600 
relates to the activities undertaken to develop a system 
software application for eventual delivery to clients. The 
Delivery management step 600 translates the required busi- 
ness outcomes into a business solution. A business solution 
is the combination of business process, a technology solu- 
tion and organizational changes that collectively create 
value by improving business performance. The Delivery 
Management Module defines a multi-functional approach 
for taking each business solution from analysis to deploy- 
ment. As depicted in FIG. 6A, the delivery management 600 
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encompasses four stages of work: analysis, step 700; design, 
step 800; building and testing, step 900; and deployment, 
step 1000. One of the delivery programs should be mobi- 
lized for each business solution to be delivered. 

[0196] In analysis stage 700, the organization accesses and 
defines the tasks to be accomplished for delivery of the 
desired products. During stage 700, business, user and 
interface requirements are defined as necessary to define and 
commit to a specific implementation and release plan. The 
information gathered during stage 700 focuses on business 
requirements, describing it to the level of detail needed to 
finalize the delivery releases, define the specific require- 
ments, and resolve implementation issues. As illustrated in 
FIG. 7A, the analysis stage 700 consists of defining a 
business case, step 710; gathering and analysis of require- 
ments, step 720; assessment of the deployment environment, 
step 730; and identification and analysis of the application 
and interface requirements, step 740. 

[0197] The first step in the analysis stage 700 is the 
defining of a business case, step 710, which is illustrated in 
FIG. 7B. In step 710, the organization defines the business 
case to determine benefits to be derived from, and justifi- 
cation for a proposed business solution. When defining a 
business case in step 710, the organization first determines 
an economic evaluation approach, step 711. Specifically, the 
organization performs this task to obtain commitments from 
the appropriate stakeholders in the sponsoring organization 
on the overall implementation approach for the proposed 
solution. This task treats the process of implementing a 
solution as an investment. 

[0198] The organization subsequently creates a model 
structure, step 712. During this task, the organization obtains 
an agreement from the sponsoring organization regarding 
the structure of the model used to determine the benefits of 
implementing the proposed solution. For example, benefits 
to be derived may be expressed in terms of increased market 
share or reduced operating costs. 

[0199] The organization next forecasts baseline business 
performance, step 713, to determine how the business 
should perform without the proposed solution. The next step 
in the analysis stage 710 is to project net change journey 
benefits, step 714, during which the organization attempts to 
predict and quantify the benefits that the sponsoring orga- 
nization should derive from implementing the proposed 
solution. A further step in the analysis stage 710 is to 
assemble a business case, step 715. During step 715, the 
organization documents a rationale for implementing the 
proposed solution. Ultimately, this document should serve as 
a motivational tool for change. 

[0200] Turning now to FIG. 7C, the next step in the 
analysis stage 700 is the gathering and analysis of require- 
ments, step 720. In step 720, the current business environ- 
ment is assessed and new requirements for the business and 
users are defined. During the gathering and analysis of 
requirements in step 720, the organization analyzes its 
current business, step 722, to obtain an accurate picture of its 
elements, its operation, and its performance. The organiza- 
tion then identifies user and business requirements, step 724, 
to define and document high-level requirements for desired 
solutions. These requirements include changes to human 
performance, business process, and technology. The orga- 
nization should seek to ensure that these requirements meet 



the needs stated in the proposal, business needs statement, 
work request, or task order, including interfaces to other 
systems. During step 724, project participants impacted-by 
the requirements should be involved in the review and 
sign-off of the requirements. Another step in the gathering 
and analysis of requirements in step 720 is to document the 
new business environment, step 726. In step 726, the orga- 
nization documents user locations and transaction volumes 
in any new business environment. 

[0201] As illustrated in FIG. 7D, the analysis stage 700 
continues with the assessment of the deployment environ- 
ment, step 730, to ensure that deployment concerns and 
needs are considered sufficiently early in the development 
process. The objectives of the task are to consider the 
geographical, infrastructure, operational, and cultural differ- 
ences between the current structure of the sponsoring orga- 
nization and the desired structure, to define the deployment 
requirements, and to determine the optimal deployment 
mechanism. 

[0202] In the evaluation of the deployment environment in 
step 730, the organization assesses its release approach, step 
732, to review the deployment plan, particularly to identify 
risks and to justify costs for deployment. The organization 
further identifies deployment requirements, step 734, to 
identify deployment requirements for the proposed solution. 
A key deployment requirement is the production and release 
of the deliverable product or service. The organization 
should document the identified deployment requirements 
within a business requirements document. 
[0203] The next step in the analysis stage 700 is the 
identification and analysis of the application and interface 
requirements, step 740. During step 740, the application and 
interface requirements are prepared based on the business 
and user requirements gathered. All agreed-upon require- 
ments gathered to this point are entered in the Requirements 
Traceability Matrix. Step 740 is generally illustrated in FIG. 
7E and comprises these steps: transforming business 
requirements into more detailed application and interface 
requirements, step 741; integration of performance support 
requirements, step 742; recovering current application and 
interface design, step 743; identifying application and inter- 
face quality requirements, step 744; analyzing application 
and interface requirements, step 745; and verifying require- 
ments documentation, step 746. 

[0204] During the transforming of business requirements 
into more detailed application and interface requirements in 
step 741, the organization uses the business requirements as 
a starting point to develop the application requirements. The 
application requirements should be in the context and scope 
of the business requirements. Also, these requirements 
should be verified to help ensure that the business process 
designs were properly interpreted. Then, in step 742, the 
integration of performance support requirements, the orga- 
nization analyzes the tasks and factors that hinder user 
performance, taking into account their background and 
behavior. 

[0205] As illustrated in FIG. 7E, the next task in the 
identification and analysis of the application and interface 
requirements, step 740, is the recovery of current application 
and interface design, step 743. The recovery of current 
application and interface design in step 743 entails review- 
ing me current application/interlace aocumentation and 
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physical structures to gather requirements that may be 
omitted from the new application/interface. Step 743 
includes the documentation of the present logical data 
structures. The organization should further identify expected 
requirements that otherwise may be assumed by die business 
representatives and not considered. Another task in step 743 
is to verify that the review also covers interface require- 
ments. In this way, the recovery of current application/ 
interface design in step 743 provides an inventory for 
conversion and a potential starting point for bottom-up data 
modeling. 

[0206] Subsequently, in step 744, the organization identi- 
fies application and interface quality requirements, as illus- 
trated in FIG. 7E. During step 744, die organization seeks 
to select the quality attributes used to measure the applica- 
tion/interface functional and usability requirements, as these 
quality attributes should guide the design. Using these 
requirements, the organization should analyze application 
and interface requirements, step 745. Specifically, the orga- 
nization should perform an analysis of the gathered require- 
ments using process, event, data and content modeling 
techniques. Similarly, the organization may use validation 
techniques to confirm requirements such as prototyping and 
simulations. The organization may also create cases or 
scenarios to ensure requirements will be operational. The 
organization may additionally perform risk assessment 
against the identified requirements. 'ihe organization next 
documents the application and interface requirement speci- 
fications using a template. The actual requirements should 
be documented using a requirements traccability matrix for 
future tracking against other work products. The organiza- 
tion should make verify requirements are documented in a 
manner to ensure bidirectional traceability so that it is 
possible to trace requirements from the requirements devel- 
opment phase to the testing phase and vice versa. In addi- 
tion, it should be possible to trace requirements across 
interfaces. In performing step 745, the organization prefer- 
ably involves project participants impacted by the require- 
ments in the review and sign-off of the requirements 

[0207] Returning to FIG. 7E, the next step is to verify the 
documentation of requirements, step 746. Specifically, the 
organization should review all requirement documents, such 
as executive architecture, development architecture, and 
operational architecture, thereby ensuring that these docu- 
ments are in sync. 

[0208] Returning to FIG. 6A, the next set of tasks in the 
delivery management 600 is to design, step 800. The design 
stage 800 focuses on designing the components of the 
technology infrastructure, including the execution/opera- 
tions and development architectures. In addition, the design 
of the network, communication and computing platforms is 
performed in this stage. Design work should be coordinated 
with the development of the business processes, technical 
solution and organizational changes required to support the 
new infrastructure. The design process 800 is comprised of 
two tasks: designing the technology infrastructure, step 801 
and designing the application, step 802. 

[0209] FIG. 8A illustrates one embodiment of the design 
of the technology infrastructure in step 801. One of the tasks 
in step 801 is to identify and analyze technology infrastruc- 
ture requirements, step 810. During step 810, the organiza- 
tion prepares for the selection and design of the technology 



infrastructure and establishes preliminary plans for technol- 
ogy infrastructure releases and product testing. Furthermore, 
technology-related requirements are refined to form the 
component requirements for the technology infrastructure. 
For instance, step 810, the requirements for the technology 
infrastructure are outlined and preliminary plans for tech- 
nology infrastructure releases and product testing are estab- 
lished. As this task is performed, technology-related require- 
ments are refined to form the component requirements for 
the technology infrastructure. Accordingly, a first task in the 
identification and analysis of technology infrastructure 
requirements during step 810 is to identify technology 
infrastructure requirements, step 811, as illustrated in FIG. 
8B. The organization performs step 811 to identify the 
functional, technical, and performance requirements for the 
technology infrastructure that should support the solution. 
During step 811, the organization also identifies key perfor- 
mance indicators, creates baseline estimates of transaction 
volumes and system size, and sets measurable targets for the 
performance indicators. Key performance indicators exam- 
ined during step 811 include resource availability, capacity, 
throughput, reliability, scalability, and usability. 
[0210] As indicated in FIG. 8B, a second process in the 
identification and analysis of technology infrastructure 
requirements in step 810 is to assess the technology infra- 
structure's current environment, step 812. In step 812, the 
organization assesses the ability of the existing technology 
infrastructure to support identified technology infrastructure 
requirements. 

[0211] As depicted in FIG. 8B, the organization subse- 
quently analyzes any potential technology infrastructure 
requirements, step 813, to refine the detailed functional, 
technical, and performance requirements for the technology 
infrastructure as outlined in the physical and performance 
models and to cover any additional requirements during the 
assessment of the current environment. The additional 
requirements may include user and service level require- 
ments, as well as any requirements for the development 
architecture or the execution/operations architecture. The 
organization seeks to analyze and document the require- 
ments for each component of the technology infrastructure 
and define additional needs. As part of step 813, the orga- 
nization also seeks to involve all project participants 
impacted by the requirements in the review and sign-off of 
the requirements. 

[0212] Returning to FIG. 8B, other steps in the identifi- 
cation and analysis of technology infrastructure require- 
ments in step 810 are (1) verification that requirements 
documentation is in sync, step 814, and (2) performance of 
risk assessment against the technical requirements, step 815. 

[0213] As illustrated in FIG. 8A, the next step in the 
design of the technology infrastructure, step 801, is the 
selection and design of execution/operation hardware, step 
820. The organization performs step 820 to create and 
document high-level design and component design for the 
execution/operation architecture. Preferably, to prepare for 
testing of the architectural components, an architecture test 
plan, conditions, scripts and other needed family are also be 
created or defined during step 820. 

[0214] FIG. 8C depicts the individual steps of the selec- 
tion and design of execution/operation hardware in step 820. 
A first step in the selection and design of execution/opera- 
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tion hardware in step 820 is to identify execution/operation 
architecture component options, step 821, so that the orga- 
nization may create a list of suitable options for selecting 
and designing execution/operation architecture components 
that satisfy the technology infrastructure requirements. The 
organization then selects any reused execution/operation 
architecture components, step 822, if the execution archi- 
tecture should utilize reused components from other 
projects, so that the organization may create a list of suitable 
options for selecting and designing those components that 
satisfy the execution/operation technology infrastructure 
requirements. The organization may also select packaged 
execution/operation architecture components, step 823, if 
packaged components should be used in the project. The 
organization may perform step 823 to evaluate packaged 
products then and to gain the sponsoring organization's 
approval to continue. If suitable reusable or packaged com- 
ponents cannot be found, the organization may also choose 
to design custom execution/operation architecture compo- 
nents, step 824. If custom execution/operation components 
will be created in the project, the organization may then 
compare reused or packaged execution/operation solutions 
against custom-designed alternatives. 
[0215] Another step in the selection and design of execu- 
tion hardware 820 is to design and validate the execution/ 
operation architecture, step 825, to develop a complete 
design for the execution/operation architecture design after 
individual components have been selected or designed. The 
design for execution/operation architecture should also 
include custom component designs and any reused and 
packaged execution/operation architecture extension 
designs. 

[0216] Another step in the selection and design of execu- 
tion/operation hardware 820 is to develop ait execution/ 
operation architecture test plan, step 826, after the execu- 
tion/operation architecture design is understood and 
documented, including the selection of reused and packaged 
execution/operation components. The primary goal of step 
826 is to document test approaches and plans for the 
execution/operation architecture at the component and 
assembly level. 

[0217] The next step in the design of the technology 
infrastructure during step 801 is to select and design devel- 
opment architecture, step 830, as illustrated in FIGS. 8A 
and 8D. The organization may perform this task to create 
and document the design of the development architecture 
components and test plans for those components. Specifi- 
cally, the organization may create a high-level development 
architecture and component designs. Preferably, to prepare 
for testing of the architectural components, an architecture 
test plan, conditions, scripts and other needed family are also 
be created or defined during step 830. 
[0218] FIG. 8D illustrates the substeps in the selection 
and design of development architecture in step 830. A first 
substep is to identify development architecture component 
options, step 831. In step 831, the organization may create 
and document the design of the development architecture 
components, as well as the test plan for those development 
architecture components. The organization also finalizes the 
physical model and selects or designs for development 
architecture components. 

[0219] Other tasks in step 830 include the selection of 
reused development architecture components from the exist- 



ing technology infrastructure or from external sources, step 
832, and the selection of packaged development architecture 
components, step 833, if they should be used in the project. 
If the organization should use any packaged development 
architecture components, the organization should determine 
which pieces of the development architecture to use and to 
negotiate contracts with vendors. In a preferred implemen- 
tation of step 833, the organization also gathers additional 
information during vendor demonstrations and site visits to 
evaluate the available packaged development architecture 
components. 

[0220] Another substep in the selection and design of 
development architecture of step 830 is to design custom 
development architecture components, step 834, if any cus- 
tom-designed components are needed. The organization 
may choose to produce a design for each custom component 
in order to understand the complexity, effort, and skills 
required to design and build the components efficiently. 

[0221] In another embodiment of step 830, the organiza- 
tion also designs and validates the development architecture, 
step 835, to review the development architecture require- 
ments such as interfaces between components, to design 
custom development architecture components, and to incor- 
porate any reused or packaged components. The organiza- 
tion may also develop a development architecture test plan, 
step 836. The organization should develop a test approach 
and a plan for testing, concurrently with the design and 
prototyping of the development architecture. Before devel- 
oping the test approaches and plans for each component and 
the assembly of the development architecture, the organiza- 
tion should further review the objectives and scope for the 
component, component acceptance, and assembly test 
approach as defined in the test strategy. 
[0222] Returning FIG. 8A, a preferred embodiment of the 
delivery management stage also includes a peer review, step 
840, of the other steps 810-830 undertaken during the 
process of designing the technology infrastructure, step 800. 
In the peer review, the organization verifies the accuracy and 
completeness of a deliverable product, whether it is a 
document or code, for any step in the delivery stage 600. It 
should be appreciated that, while displayed at this point in 
the CMM in a BOX method 10, a peer review 240 may be 
implemented at any time as necessary to satisfy the require- 
ments of the CMM or CMMI as well as other overriding 
business concerns. 

[0223] Referring to FIG. 8E, the organization implements 
the peer review by first preparing for the review, step 842. 
Specifically, the project manager and team leader should 
budget time to conduct peer reviews and to establish peer 
review standards and criteria. Also, the owner of the deliv- 
erable product should identify and contact any peer review 
participants, schedule the peer review session, and distribute 
materials and standards to the reviewers. The reviewers 
should then prepare for the review by reading the materials 
prior to the peer review session and documenting comments 
and recommendations. Where appropriate, a peer review 
checklist may be used when conducting the peer review. 

[0224] Continuing with FIG. 8E, the next step in the peer 
review 840 is to conduct the peer review, step 844. During 
the peer review session in step 844, the deliverable owner 
should document any defects, issues, risks, and action items. 
The deliverable owner should also record meeting minutes 
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and the time spent on the review. The reviewers are gener- 
ally responsible for facilitating the discussion, sharing com- 
ments and recommendations with the deliverable owner, 
confirming that all issues are documented, providing metrics 
data, and scheduling a follow-up session if necessary. 
[0225] Next, in step 846, the organization should perform 
any necessary rework of the product, as depicted in FIG. 8E. 
During the rework in step 846, the deliverable owner imple- 
ments the actions recommended by the reviewers, collects 
metrics data (including time spent preparing for review, 
number of defects found, etc.), and monitors the status of 
defects, issues, risks, and action items. As necessary, the 
peer reviewer should also verify that all pertinent items have 
been closed. 

[0226] The organization should then analyze the review 
results, step 848 as depicted in FIG. 8E. The team leader 
submits the peer review metrics to the project manager for 
review. The project manager is then generally responsible 
for analyzing the metrics, evaluating the execution of the 
peer review process, and identifying areas for process 
improvement or corrective action with the peer review 
process. 

[0227] Returning to FIG. 6A, the next step in the delivery 
management, in step 600, is to design an application, step 
802. As illustrated in FIG. 8F, during the design of the 
application in step 802, the organization designs an appli- 
cation architecture, step 850, to develop and document the 
conceptual and general design of the application and designs 
a database, step 860, to transform the data model into logical 
and physical designs of the application's database, while 
ensuring that data requirements should be met, and that data 
should be available through a conversion process. The 
design of the application in step 802 also entails planning a 
testing approach, step 870, for developing a comprehensive 
testing approach that should be used at all levels of testing, 
including component, assembly, product, user acceptance 
testing, and production readiness, i.e., deployment testing. 
Then, in step 880, the organization designs a performance 
support approach to determine existing workforce training 
needs, as well as to design methods and standards for 
performance support products to meet those workforce 
training needs. 

[0228] During the design of the application architecture in 
step 850, the organization seeks to develop and document 
the conceptual, general, and interface designs of the appli- 
cation. Preferably, to prepare for testing of the architectural 
components, an architecture test plan, conditions, scripts and 
other needed family are also be created or defined. As 
illustrated in FIG. 8G, the first step in the design of the 
application architecture in step 850 is to define the concep- 
tual design, step 851. Specifically, the organization should 
document the operational concept for the solution in the 
conceptual design document. This documentation should 
outline the functional architecture of the proposed solution. 

[0229] Continuing with FIG. 8G, the organization should 
next determine whether to buy or build components, step 
852, by reviewing the conceptual design and assessing 
factors such as historical information, corporate strategy, 
support infrastructure, product availability, deadlines, and 
criticality of requirements. At this point, the organization 
should define an application architecture, step 853. When 
defining the application architecture in step 853, the orga- 



nization should determine an approach for conducting 
design, such as calling group meetings for creating a con- 
ceptual approach. The organization should then evolve the 
conceptual design into a more detailed design as necessary 
for implementation with application. While evolving the 
design, key design decisions may trigger the need for a 
DAR, as described above. 

[0230] Continuing with the design of the application archi- 
tecture hi step 850, as depicted in FIG. 8G, the organization 
next undertakes the concurrent tasks of defining a process 
flow in step 854, designing application interfaces in step 
855, and planning an assembly test in step 856. In defining 
a processing flow in step 854, the organization identifies all 
programs in the application, identifies their sequence, 
decomposes the programs into modules, and identifies how 
the modules communicate. The aim of step 854 is to develop 
enough detail to estimate the application's costs, resource 
consumption, and response times. 

[0231] At the same time, the organization designs appli- 
cation interfaces, step 855. Specifically, the organization 
designs the automated interfaces between the application 
being built and other applications with which it should 
communicate. During step 855, the organization also pref- 
erably develops an interface agreement and interface design 
to outline the expectations of the parties developing the 
various components. These documents should describe the 
handling of change requests, data exchange and control, 
backup and recovery requirements, error handling proce- 
dures, and provide escalation procedures in the event of a 
conflict. 

[0232] At the same time, the organization also plans 
assembly tests, step 856, by developing an approach and a 
plan that should be used to organize and execute assembly 
tests. The objective of assembly testing is to ensure that 
related components function properly when assembled into 
dialogs or batch strings and to verify that the component 
interfaces have appropriately implemented the design. 

[0233] As illustrated in FIG. 8F, the next step in the 
application design 802 is to design a database, step 860. 
When designing a database in step 860, the organization 
transforms the data model into logical and physical designs 
of the application's database, acts to ensure that all data 
requirements should be met, and that all data should be 
available through the conversion process. The steps in the 
database design 860 are illustrated in FIG. 8H. The first step 
in the database design 860 is to design a logical database, 
step 862. The organization may perform this task to trans- 
form the data model into the logical data structures using 
known database techniques. If the design of the logical 
database in step 862 produces a relational database, the 
logical database includes tables that contains various data 
used to define the database such as columns, primary keys, 
and row lengths; codes tables; foreign keys; integrity rules; 
views; and denormalization of the statistical data contained 
in the database. The logical data model is typically delivered 
to a client in soft copy format using data modeling tools. 

[0234] Next, the organization designs a physical database, 
step 864, by selecting or preparing physical storage and 
access structures for the application's data and by trans- 
forming the logical database design into storage and access 
structures that can be physically implemented. The physical 
database produced in step 864 generally includes database 
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definitions, database space worksheets, database mappings, 
relational index definitions, and table space definitions. The 
database design 860 continues with designing data conver- 
sion processes, step 866, such mat the required conversion 
programs and procedures ensure the availability of data 
required by the application in production. In this step, the 
organization should produce an approach for converting and 
mapping documents. 

[0235] Returning to FIG. 8F, the design of die application 
in step 802 continues with the development of a planning 
testing approach, step 870. This planning testing approach 
should be used at multiple levels of testing such as compo- 
nent, assembly, product, and user acceptance testing, and 
deployment testing. As illustrated in FIG. 81, the first step 
in the development of a planning testing approach in step 
870 is to develop an overall testing approach by refining and 
documenting an overall approach for testing, step 872. In 
developing the overall test approach, the organization 
should plan for the testing of interfaces. The overall test 
approach produced in step 872 should include details on 
sequence testing and the testing environment and also pref- 
erably includes the documentation of the resulting detailed 
testing procedures. The next two steps in producing a testing 
approach in step 870 are (1) to identify product test condi- 
tions, step 874, where the conditions are used to verify that 
solutions meets the requirements for the components being 
created; and (2) to develop product test cycles, step 876. 

[0236] Returning to FIG. 8F, the next step in the appli- 
cation design 802 is to design a performance support 
approach, step 880, to determine existing workforce training 
needs, as well as to design methods and standards for 
performance support products to meet these workforce train- 
ing needs. In step 880, the organization also designs perfor- 
mance support test and evaluation approaches and completes 
a validation of the complete test and evaluation approach. 
With reference to FIG. 8J, the first step in the design of a 
performance support approach is to determine performance 
support needs, step 881, to determine the workforce's cur- 
rent proficiency and performance levels. This information is 
used to assess the gaps between current and expected 
proficiency and performance levels, which, in turn, drive the 
design of the performance support approach. Next, the 
organization designs learning objectives and a curriculum 
plan necessary to close the proficiency and performance 
gaps in the organization's workforce, step 882. Another step 
of the design of a performance support approach is to design 
performance support products, step 883, to define the deliv- 
ery methods and standards for performance support. These 
delivery methods may include instructor-led training, per- 
formance simulation, computer-based training, videos, 
workshops, job aids, on-line quick reference tools, and 
training databases. 

[0237] As illustrated in FIG. 8J, the next step is to design 
a comprehensive approach for testing the performance sup- 
port products with respect to achieving each product's 
learning objectives, step 884. In step 884, the organization 
generally defines an approach that includes the scope and 
objectives of the test, environment requirements, entry/exit 
criteria, metrics, and schedule. The organization then 
designs a comprehensive approach for evaluating the effect 
of the performance support products on the employees' 
competency proficiency levels and performance levels in 
specific areas, step 885. Any designed approach for perfor- 



mance support evaluation should include evaluation meth- 
ods, proficiency metrics, and schedules. The design of the 
performance support approach in step 880 may also include 
the verification and validation of the performance support 
approach and the curriculum plan with stakeholders and 
subject matter experts, step 886. The organization should 
also organize labor review sessions to determine how well 
the sessions fit together to support the training needs of the 
workforce. 

[0238] As illustrated in FIG. 6A the next step in the 
delivery management 600 is to build and test, step 900. The 
build and test step 900 concentrates on implementing the 
business solution elements required for a single release. The 
delivering teams are responsible for the detailed design and 
creation of new processes, facilities, learning systems, per- 
formance support, application systems and technology infra- 
structure necessary to implement the new solution. These 
elements are then tested and implemented within a pilot 
environment. Thus, the building and testing in step 900 is 
accomplished through building and testing the technology 
infrastructure in step 901, building and testing the applica- 
tion in step 902, and planning executing product and accep- 
tance tests in step 903. 

[0239] FIG. 9A presents the elements in the building and 
testing of the technology infrastructure in step 901. Step 901 
focuses on acquiring, developing and testing the technology 
infrastructure. During step 901, additions and extensions to 
the execution/operations and development architectures are 
implemented, physical network and computing resources are 
developed, and a unified product is tested prior to the 
application product test. The first task in step 901 is to 
acquire physical environment assets and services, step 905. 
Generally, these physical environment assets and services 
are deployed to enable the implementation of the require- 
ments based on the previously defined details of the physical 
environment assets. For instance, the organization may 
apply the data obtained in step 420. The organization uses 
the listing of physical environment assets and services to 
decide who should supply the assets and services, how the 
assets and services should be supplied, and how much the 
assets and services may cost. 

[0240] As depicted in FIG. 9B, the first step for acquiring 
physical environment assets and services is to initiate the 
acquisition of physical environment assets and services by 
selecting and appointing providers of assets and services, 
step 906. For instance, the organization preferably identifies 
those contracts that need to be negotiated on an expedited 
basis and ensures that due diligence is applied to the context 
and content of all contractual arrangements. The organiza- 
tion then selects and appoints assets and sendees vendors, 
step 907, to appoint third-party suppliers and contractors 
who may provide assets, such as property and equipment, 
and technical/build/transfer/install/maintenance services for 
deployment of the physical environment, or services relating 
to decommissioning and disposal of the existing physical 
environment. 

[0241] Again, the organizations should prioritize those 
early purchase requirements that need to be expedited on a 
"fast track" basis. Subsequently, the organization should 
evaluate the deployment implications of the vendor appoint- 
ments, step 908, to analyze the impact and deployment 
implications of appointing specific providers, either external 
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or internal. These impacts may involve additions or revi- 
sions to project documents such as deployment plans, Busi- 
ness Case, project plan, and all subordinate plans. 

[0242] Returning to FIG. 9A, the next step in the building 
and testing of the technology infrastructure, step 901, is to 
build and test the execution/operation architecture, step 910, 
in order to complete a detailed design of the execution/ 
operation architecture and to build and test that architecture. 
The organization may use the same methodology for appli- 
cation and operation development, as provided above in step 
820, to plan and perform the component tests of the execu- 
tion/operation architecture. As illustrated in FIG. 9C, the 
first step in the building and testing of the execution/ 
operation architecture is to develop program specifications 
for each custom component of the execution architecture 
and to determine software configurations for each packaged 
or reusable component of that architecture, step 911. The 
organization may use the resulting detailed design to build 
custom components and to install packaged or reusable 
components. This task may also include updating the tech- 
nology infrastructure component test plans, conducting 
reviews of the resulting detailed designs, and preparing 

[0243] The organization next builds any custom execu- 
tion/operation architecture components needed for the 
project, step 912. This step 912 may also include document- 
ing development procedures and standards, and conducting 
code reviews. The organization then prepares and executes 
a component test of the execution/operation architecture 
components, step 913, to verify that the execution/operation 
architecture components are built according to proper 
designs. During step 913, any detected errors should be 
documented, and all of the execution architecture compo- 
nents should be relatively free of errors and ready for a 
subsequent assembly test. 

[0244] As depicted in FIG. 9D, the organization should 
similarly build and test the development architecture, step 
915. The first task in step 915 is to perform a detailed design 
of the development architecture, step 916. In step 916, the 
organization develops program specifications for each cus- 
tom component of the development architecture and to 
determine software configurations for each packaged or 
reused component of that architecture. Step 916 also pref- 
erably includes updating the technology infrastructure com- 
ponent test plans, conducting reviews of the resulting 
detailed designs, and preparing common test data. The 
organization should then build any needed custom develop- 
ment architecture components, step 917. Step 917 may also 
include documenting development procedures and stan- 
dards, and conducting code reviews. The organization then 
prepares and executes a component test of the development 
architecture components, step 918, to verify that the devel- 
opment architecture custom components are built according 
to their designs. During step 918, the detected errors should 
be documented, and all of the development architecture 
custom components should be relatively free of errors and 
ready for the assembly test. 

[0245] As depicted in FIG. 6A, the build and test stage 
900 also includes the building and testing of the application 
in step 902. Step 902 focuses on building and testing the 
application, creating training materials and other forms of 
performance support required by the business solution. 



During step 902, the detailed design, component testing and 
assembly testing of the application are completed. Learning 
products and business policies and procedures are developed 
to train and guide the users of the application. FIG. 9E 
illustrates the steps involved in the process to build and test 
the application, step 902. The first of these tasks is deploy- 
ment planning, step 930, to produce deliverables that should 
be needed to test the application and interfaces in an 
operations environment prior to deployment and to run the 
application and interfaces after deployment has occurred. 
[0246] Turning to FIG. 9F, the first task in the deployment 
planning during step 930 is to develop a deployment 
approach to document the specifics of the major deployment 
activities, step 931. The documentation should include items 
such as Data Conversion, Policy & Procedure Deployment, 
Risk Mitigation, Deployment Strategy, and workforce tran- 
sition also should be covered in this document. The orga- 
nization should next develop appropriate operating policies 
to produce a document outlining specific policies in the new 
operation environment, step 932. Responsibilities, system 
availability, and security should be documented in step 932, 
and upon completion of the project, this documentation 
should be given to the client. In a concurrent task, step 933, 
the organization may develop operating procedures by pro- 
ducing a document outlining the procedures that need to be 
followed during on-going support and operation of the 
installed application. Other subsequent tasks are to develop 
the operating organization to document the long-term orga- 
nizational requirements that should be needed in the new 
operation environment, step 934, and to develop a disaster 
recovery plan that outlines an overall disaster recovery 
approach, as well as specific steps to follow during the 
disaster recovery process, step 935. The organization may 
then prepare the deployment test by creating a deployment 
test plan, test conditions, test scripts, and test data, step 936. 
This plan should be executed prior to delivery of a product 
to clients. Another step is to package operating manuals, so 
that the manuals may be turned over to client at completion 
of the project, step 937. 

[0247] The next step 940, the performing of application 
detailed design, is illustrated in FIG. 9G, and generally 
comprises a process to produce completed detailed design 
specifications that can be directly implemented in code, and 
a process to develop the approach and plan for component 
testing the application's modules. The first substep is to 
design and specify modules, step 941. Step 941 includes the 
production of a detailed design of the application and 
interfaces based on the general design and the application/ 
interface requirements specification. During step 941, the 
organization should continue use of the chosen design 
methods to complete detailed designs. The organization 
should also prepare a detailed design of the application by 
specifying all of the modules and their associated call 
patterns to the lowest level of detail. The detailed design of 
the application should also include describing each module's 
purpose and processing logic, developing database access 
patterns, and identifying other input/output operations. The 
organization should also be sure to address interfaces during 
the design process. In step 941, the organization should also 
update the interface agreement created during the design 
stage 600 to reflect any changes associated with the inter- 
faces. The next task in performing a detailed design of the 
application in step 940 is to plan component testing, step 
942, to verify the correctness of implementation of each of 
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the application modules with respect to the application 
detailed design specifications. Step 942 includes determin- 
ing common test data requirements and using the require- 
ments to create common test data that can be used in the 
different stages of testing. 

[0248] As illustrated in FIG. 9H, the next step in the build 
and test stage 900 is to build and test the application, step 
945. In step 945, the organization builds a complete, high- 
quality software application from the detailed design of the 
application. The organization may have developers imple- 
ment the modules and then review the coded modules to 
verify correctness. The organization may also execute 
assembly tests to check interfaces and interdependencies 
between modules. One task in the building and testing of the 
application is the coding of modules, step 946, to create the 
code of each of the modules according to the previously 
created detailed application design specifications. Once the 
code is generated, the organization should check and com- 
pile the code as necessary for the project to identify and fix 
all errors, and to ensure that developers have followed any 
detailed coding procedures outlined in the project develop- 
er's guide. 

[0249] Continuing with FIG. 9H, the goal of the next step, 
the preparation and execution of the component tests in step 
947, is to execute module code and verify that the module 
specification was correctly translated to the code. The mod- 
ule code should be verified using the component test con- 
ditions from the component test plan to prepare the test data 
and test scripts for the component tests. The organization 
should document and fix all detected errors before proceed- 
ing. The organization may then prepare and execute assem- 
bly tests, step 948, as needed to integrate modules and verify 
that their interfaces and interdependencies are correctly 
designed and implemented. In step 948. the organization 
should use the assembly test conditions from the previously 
prepared assembly test plan to prepare test data and test 
scripts for the assembly tests. All detected errors should be 
fixed before proceeding. The next step, the development of 
a support program in step 949, involves coordinating and 
controlling the efforts of the development teams by support- 
ing the programming and testing effort through supervision, 
control, and coordination. The organization may manage the 
programming and testing schedule, and monitor progress 
and report status, via the project management task packages 
outlined in the document repository policy defined in earlier 

[0250] As depicted in FIG. 91, at this point in the build 
and test stage 900, the organization may develop a finalized, 
detailed set of policies and procedures, step 950. The busi- 
ness policies and procedures consist of rules governing work 
within the organization (policies) and the workflow for 
executing these rules (procedures). A first task in step 950 is 
to perform a detailed design of policies and procedures, step 
952. hi step 952, the organization should (1) define the 
product structure and design and (2) create and develop 
prototype templates for all policies and procedures. The 
organization should then develop business policies and 
procedures, step 954, by drafting a complete set of business 
policies and procedures to support the pending product 
release. In step 954, the business policies describe the 
business rules governing workflows and drive the develop- 
ment of business procedures and user procedures documen- 
tation. Similarly, the business procedures describe the 



sequential sets of tasks (and related resources, metrics, etc.) 
to follow based on the business policies. The organization 
should next validate and test these policies and procedures, 
step 956, to ensure that the Business Policies and Procedures 
meet the content of the requirements and can be executed by 
use of the applicable application. In step 956, the organiza- 
tion should further verify that the information collected is 
complete and accurately describes the processes. 

[0251] Turning to FIG. 9J, the next task in the building 
and testing of an application in step 900 is to develop 
learning products, step 960. In step 960, the organization 
selects the relevant authoring and development tools and to 
define standards, templates, and development procedures. 
Step 960 further includes the defining of detailed learning 
objectives, determining learning context, and designing 
learning activities. The organization should also review 
paper-based learning product prototypes for ease of use. 
Also, the organization should develop activities and content, 
and define the support learners should require, and develop 
learning program evaluation materials for during-delivery 
and post-delivery evaluation of the learning process. Thus, 
in step 960, the organization should prepare and execute 
testing to ensure each learning product meets the stated 
objectives and instructors are effective when using the 
learning products. 

[0252] As depicted in FIG. 9 J, one task in the develop- 
ment of learning products in step 960 is to define learning 
product standards and a development environment, step 961, 
after the scope of the learning program has been defined and 
the learning requirements have been identified. In step 961, 
the organization should further select authoring and devel- 
opment tools and define the standards, templates, and pro- 
cedures for the learning products. Development environ- 
ments typically include Word or PowerPoint-based 
instructor-led materials or computer-based applications, but 
can also be made more robust with the use of job aids, a 
training database, on-line quick reference tools, and videos. 

[0253] Returning to FIG. 9J, concurrent steps in the 
developing of learning products in step 960 are (1) perform- 
ing a detailed design of a learning program, step 962, to 
specify how each learning product identified in the learning 
product design should be built to meet the business needs of 
the organization and (2) prototyping learning products, step 
963, to complete low-fidelity prototypes and conduct ease- 
of-use sessions on learning components (e.g., activities, 
support system, and instructor guide) of classroom-based 
learning products. 

[0254] In addition, the organization may create learning 
and evaluation products, step 964, to develop the learning 
materials proposed and prototyped during the learning 
design activities. The creation of learning and evaluation 
products in step 964 involves the developing of activities, 
content, and support materials that the learner will require to 
complete the learning product. Furthermore, evaluation 
tools are also preferably created in step 964 to ensure that 
learners have met the learning objectives. Another possible 
task in the development of learning products in step 960 is 
the testing of learning products, step 965, which is best 
implemented after documenting participant profile, sample 
size, learning testing methods, test cycles, expected results, 
and script outlines. The goal is to test each learning product 
with the intended audience to ensure that the product meets 
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the stated learning objectives, that the instructors are effec- 
tive, and that the learning product meets the overall learning 
objectives for the release. The organization may also pack- 
age the learning products, step 966, so that the learning 
products may be handed over to an appropriate stakeholder 
at the end of the project. 

[0255] At this point, the organization may plan and 
execute the product test and acceptance test, step 903, as 
illustrated in FrGS. 6 and 9K. Product tests evaluate 
whether the product is properly functioning, whereas accep- 
tance tests evaluate whether the product functions as desired 
by customers. Step 903 focuses on performing a product test 
and user acceptance test on the new application to verify the 
application components and related technology, processes, 
and procedures work together properly according to the 
application and interface requirements. The first task in step 
903 is to prepare and execute a product test plan, step 970, 
following the creation of the product test plan, conditions, 
scripts, and data that are used to execute the product test. The 
planning and execution of the product test plan in step 970 
should not begin until all requirements are finalized, the 
assembly test has been successfully completed, and the 
testing approach has been finished. 

[0256] As illustrated in FIG. 9L, to prepare and execute a 
product test, the organization should prepare a product test 
plan, step 971, to design and create the test conditions, test 
scripts, and test data for product testing. The organization 
should then review its product test plan, step 972, to verify 
that tile product test plan created in step 971 is complete and 
accurate prior to product test execution. The resulting benefit 
to this check is that errors are caught early in the test process, 
where they can be addressed with minimal effort, rather than 
during test execution, where correction of errors becomes 
more costly. The organization should also create, cleanse, 
and convert data, step 973, to prepare the data for product 
test execution. If needed, the organization may confirm die 
product test environment, step 974, to verify that the product 
test environment is ready for application product test execu- 
tion by confirming that associated items are transferred to 
the test environment and that the identified configuration is 
complete and accurate. In this way, in step 974, the organi- 
zation verifies that any tools needed for managing and 
executing the product test (for example, scripting tools and 
test data management tools) are installed and fully opera- 
tional. This step 974 also helps ensure that the test data is 
properly copied and identifies responsibility and authority 
levels for managing code migration into the product test 
environment. 

[0257] Continuing with FIG. 9L, following confirmation 
of the test, the organization may execute the product test, 
step 975, to verify that the new application can work with the 
related technology, processes, and procedures to support the 
business processes successfully. The product test should 
prove: (1) that the new application and interfaces perform 
according to the application/interface requirements estab- 
lished in prior steps, and (2) that the application can operate 
effectively in concert with all other production applications 
and all available end-user manuals and procedures. 

[0258] If any problems arise during the testing, the orga- 
nization may perform product test fixes, step 976, to analyze 
and resolve all problems identified during product test 
execution as illustrated in FIG. 9L. Typically, the organi- 



zation assigns each problem to a specific team member for 
correction. After a problem is fixed, the organization may 
reexecute the test condition to verify that the fix was 
successful, and perform a regression test to ensure other 
components were not adversely affected by the fix. Once all 
errors have been resolved the product test can be considered 
complete. 

[0259] Returning to FIG. 9K, the organization may next 
prepare and execute acceptance tests, step 980. The organi- 
zation performs step 980 to create the test plan, test condi- 
tions, test scripts, and test data for user acceptance testing. 
The user acceptance test (UAT) also validates that the 
solution supports the business performance model and 
should not begin until successful completion of the product 
test in step 970. The UAT verifies that the solution works 
according to the requirements and meets the business objec- 
tives. As depicted in FIG. 9M, steps 981-986, the prepara- 
tion and execution of the acceptance tests during step 980 
are very similar to steps 971-976. For instance, the initial 
step of the preparation and execution of the acceptance tests 
in step 980 is to prepare a user acceptance test plan, step 981, 
including plans for testing interfaces and the application. 
The organization then reviews the user acceptance test plan, 
step 982, to ensure that the user acceptance test plan is 
complete. The next step is to create, cleanse, and convert 
data, step 983, as needed, to prepare the data required for the 
acceptance testing, including producing new data, convert- 
ing existing data, and reconciling different data representa- 
tions and different database schema representations. If nec- 
essary, the organizations may also confirm user acceptance 
of the test environment, step 984, to ensure: (1) that the user 
acceptance test environment is ready for test execution by 
checking that all necessary items are transferred to the test 
environment, (2) that the identified configuration is com- 
plete and accurate, and (3) that any tools required during the 
acceptance test are installed and fully operational. 

[0260] At this point the organization executes the user 
acceptance test, step 985, to test the interaction between the 
components of the solution to verify and validate that they 
support the model. This acceptance test helps to ensure that 
the solution works according to the requirements and meets 
the business objectives. If any problems arise in the test, the 
organization may resolve user acceptance test issues, step 
986. Specifically, the organization may utilize the user 
acceptance test issues to analyze all problems identified by 
the user acceptance test execution through investigating 
each problem, and assigning it to the appropriate develop- 
ment team for correction. After a problem is fixed, the 
organization should reexecute the test condition to verify the 
fix was successful. The organization may also perform a 
regression test to ensure other components were not 
adversely affected by the fix. Once all errors have been 
resolved in step 986, the acceptance test may be considered 
complete. 

[0261] Once solutions to a problem have been analyzed in 
step 700. designed in step 800, and built and tested in step 
900, an organization may deploy the complete solution, as 
depicted in FIG. 10A. The deployment stage 1000 is con- 
ducted to transition the organization to the new business 
solution. The deployment stage 1000 includes the activities 
required to transform the personnel, business process, and 
technology elements required to establish the business solu- 
tion. The deployment stage is repeated for each deployment 
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site, which is the organizational or geographic unit that will 
receive the business solution. The first step in the deploy- 
ment is to transition users and to deploy policies and 
procedures, step 1010, to evaluate the existing workforce of 
an organization in terms of roles and skills, and perform a 
gap analysis against the new organization infrastructure for 
the deployment unit, as illustrated in FIG. 10B. In step 1010, 
the organization may finalize the workforce infrastructure, 
step 1011, to mobilize the people who should eventually use 
the solution. At the same time, the organization should 
examine the organizational structure, as well as the skills 
and roles of the existing workforce, to determine if the 
resources needed to support the solution exist. If needed 
roles or skills are missing, anodter task in step 1011 is to 
develop a plan to address the gaps. This task should be 
performed before selecting, hiring, or assigning people to 
teams. 

[0262] As illustrated in FIG. 10B, the next task is to 
redeploy the workforce, step 1012, to transfer existing users 
into the different roles, teams, or functional areas needed to 
support the solution. Concurrently, the organization recruits 
and selects a workforce, step 1013, after developing a profile 
of the combination of skills and other characteristics nec- 
essary to support the solution and using the resulting profile 
to select internal individuals and to hire external individuals 
who can fill the necessary roles and teams. The organization 
dien trains the trainers, step 1014, by preparing the instruc- 
tors and coaches who should eventually train the workforce 
to use the solution. Step 1014 generally entails conducting 
practice sessions of the course in order to allow instructors 
to rehearse their delivery with course developers as the 
audience. Next, the organization implements orientation and 
training, step 1015. Specifically, the organization introduces 
employees to the solution that should be deployed. To 
maximize the benefits of training in step 1015, the instruc- 
tors should be trained in step 1014 prior to the training of the 
workforce. The organization may further give users infor- 
mation on the context of the solution within the organization 
and train them on how to operate the solution. Furthermore, 
the organization preferably identifies individual and team 
development needs, and workers should provide feedback 
on the learning program in order to improve the process for 
future releases. Step 1015 should be performed after select- 
ing and recruiting individuals to fill the roles and teams, and 
after developing the training materials and job aids. 

[0263] Concurrent with above-described steps 1011-1015, 
if needed in response to the deployment, the organization 
may install the new business policies and procedures, step 
1016. In step 1016, the organization also acts to en sure that 
all pieces of the new business policies and procedures are 
available. 

[0264] The next step of deployment stage 1000 is to 
deploy the physical environment, step 1020, as illustrated in 
FIG. 10C. In step 1020, the organization manages the 
implementation of changes to facilities, equipment, and 
other physical assets. Upon completion of step 1020, a 
formal exchange of the transformed physical environment 
from the project team to the sponsor's operating manage- 
ment may occur. 

[0265] Continuing with FIG. 10C, one task in deploying 
physical environment in step 1020 is to initiate physical 
environment deployment, step 1022, to mobilize the internal 



and externa] resources to prepare the physical environment 
for the solution that should be deployed, and to establish the 
necessary communication channels. One aspect of step 1022 
is to verify that all of the involved parties understand what 
work for which they are responsible, when this work is 
scheduled, and how this work is interdependent with the 
tasks assigned to others. Other tasks in step 1022 may 
include defining how to monitor, expedite, and report 
progress. The organization may optionally determine how to 
maintain quality control and how to regularly communicate 
progress with stakeholders. Also, step 1022 may include 
planning for formal progress and quality control reviews. 
[0266] Returning to FIG. 1 0C, the next step hi the deploy- 
ment of the physical environment during step 1020 to is to 
manage physical environment transformation, step 1024, to 
carry out the development and configuration of the physical 
environment needed to support the solution. The manage- 
ment of physical environment transformation in step 1024 
includes expediting progress, managing issues and risks that 
may impact the implementation plan, and providing man- 
agement with summary progress reports. 
[0267] Continuing with FIG. 1 0C, another the next step in 
the deployment of the physical environment during step 
1020 is to complete a physical environment handover, step 
1026. During 1026, the organization acts to ensure that the 
development and configuration of the physical environments 
are complete, and are transferred to. and accepted by, the 
sponsoring organization's operations management. Step 
1026 generally occurs when both the stakeholders and the 
deployment project management team are satisfied that the 
implementation has been completed successfully. 
[0268] As depicted in FIG. 1 0D, the next task is to deploy 
the application, step 1030, to transition the new application 
and its operating environment into the deployment unit. 
During step 1030, the organization may establish the data 
required by the new application; configure the operating 
environment to the needs of the deployment unit; install the 
application; configure application parameters needed for the 
deployment unit; and verify that the application is correct 
and consistent for the deployment. Tasks in step 1030 may 
include the creation, cleansing, and conversion of data, step 
1 032, as needed, to establish the data to be used with the new 
application. During step 1032, an organization may produce 
new data and reconcile different data representations and 
different database schema representations. The organization 
may also convert an existing electronic representation of 
data into a format to be used by the new application or use 
a data conversion application to convert data from an 
existing database to the new database. 
[0269] As depicted in FIG. 10D, a concurrent task is to 
configure the application, step 1034 in order to configure and 
customize the new application and the existing operating 
environment to the needs of the deployment unit. Next, the 
organization installs the application, step 1036. Specifically, 
the organization may, during step 1036, install and custom- 
ize the application components of the business capability in 
the deployment unit, making sure that all pieces of the new 
application are available. Another task in the deployment of 
the application during step 1030 is to verify application, step 
1038, by installing and customizing the new application 
components of the business capability in the deployment 
unit, making sure that all pieces of the new application are 
available. 
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[0270] As illustrated in FIG. 10E, another step in the 
deployment stage 1000 is to deploy the technology infra- 
structure, step 1040. During step 1040, the organization 
preferably outlines of the procedures and considerations for 
deploying technology infrastructure components at a 
deployment unit. Likewise, the organization should address 
the potential differences in technology infrastructure envi- 
ronments between deployment units. The goal of step 1040 
is to bring the deployment unit up to the technology infra- 
structure baseline required for the business capability. 
Deployment of the technology infrastructure in step 1040 
may also include the commissioning and decommissioning 
of infrastructure components. To deploy the technology 
infrastructure in step 1040, the organization may also con- 
figure the technology infrastructure, step 1042, to customize 
the deployment unit's technology infrastructure in prepara- 
tion for the new business capability components. Step 1042 
generally does not handle the configurations that are part of 
the installation of any new technology infrastructure ele- 
ments. Next, the organization installs the technology infra- 
structure, step 1044, to install the technology infrastructure 
components of the business capability. The organization 
should also verify the available technology infrastructure, 
step 1046, so that whenever a technology infrastructure 
component is added or modified, the organization performs 
this task to verify the new technology infrastructure envi- 
ronment and addresses the discoveries of the testing. This 
verification in step 1046 is generally completed only for the 
technology infrastructure. 

[0271] The next task in the deployment stage 1000 is to 
activate and test a solution, step 1050, to verify the deploy- 
ment and launch the new operating management processes. 
Step 1050 generally includes actions required to finalize 
performance targets, to remove redundant legacy elements, 
and to stabilize the deployment unit for transition to opera- 
tions management. One task in the step 1050 is to verify 
workforce and business readiness, step 1051, after success- 
ful completion of the acceptance test and after all elements 
have been deployed, but before the business capability is 
activated. Step 1051 includes execution of the deployment 
test and verifies that the workforce and the other elements of 
the business are prepared for operation on the first day and 
all subsequent days. The organization may use the SIRs or 
CRs to record any errors encountered. 

[0272] A concurrent task is to verify team and process 
readiness, step 1052, after all elements have been deployed, 
but before the business capability is activated. Step 1052 
verifies that the deployment team and the deployment pro- 
cesses are prepared to activate the new business capability. 
Organizations may also activate and verify the deployment, 
step 1053, to activate and verify the capabilities that have 
been deployed. In step 1053, any of the organization's 
various teams should have the confidence and ability needed 
to proceed with irreversible decisions, such as the removal 
of legacy systems and procedures. The organization should 
now begin to operate the deployed business capabilities. 

[0273] Next, the organization may remove legacy ele- 
ments, step 1054, to remove the legacy systems from old 
operations and management processes after making the 
irreversible decision to proceed with the new business 
solution. Concurrent with step 1054, the organization should 
finalize performance targets, step 1055 to formalize the 
baseline for continuous improvement of the business solu- 



tion. The finalizing of performance targets is initiated as 
soon as the business solution has been operating long 
enough to collect reliable data for adjusting the business 
performance model. 

[0274] In another step, the organization may deploy sta- 
bilization, step 1056, to prepare the transition of business 
capabilities to operations management. The organization 
should also monitor the progress over a period of time to 
verify the stability of the team using the deployed business 
capabilities. A decision that the product is ready to release is 
reached by analyzing the actual performance and produc- 
tivity forecasts of the team using the deployed business 
capabilities. 

[0275] Turning now to FIG. 6B, maintenance, step 610, is 
the continuing support of an application, addressing both 
production problem resolution (through SIRs) and applica- 
tion enhancements (through CRs). The first task in the 
maintenance is to review the SIRs or CRs, step 611. With a 
SIR, repair work needs to be completed immediately, 
whereas a CR may be incorporated into a subsequent release 
of the application. The organization may also review inci- 
dent or change requests for risk as well. Another step in the 
maintenance 610 is to perform an impact assessment, step 
612. Specific activities in step 612 include investigating the 
SIR; detennining the change required to address the iden- 
tified problems to resolve the SIR; determining the effort 
involved; developing alternatives; and selecting the accept- 
able alternative. Any affected work products altered by the 
SIR such as requirements, designs, work plans, code, etc., 
should be updated as necessary. If it is detennined that no 
application change is needed, the system should be retested 
to ensure that the problem no longer exists or that the 
problem should be forwarded to the appropriate channels. 
[0276] Another task in the maintenance 610 is to design 
application changes, step 613, to create the application 
design that is needed to build the solution. The organization 
may also build and test application changes, step 614, to 
perform the work necessary to implement the desired 
change. Once the change has been completed, the change 
should be component tested and product tested to ensure that 
it is working properly. Additionally, a regression test should 
be performed in step 614 to help ensure that other peripheral 
functions were not affected by the change. Next, the orga- 
nization may roll out changes, step 615, as needed to 
implement the designed, developed, tested changes into the 
production environment. 

[0277] For CRs corresponding with desired enhancements 
to the product, the organization may also follow the program 
delivery life cycle, step 616: For changes (CRs) that can be 
incorporated into a scheduled release, the detailed work 
involved in modifying the existing application is performed 
according to the task packages/tasks in the delivering phase 
600, including the analysis, design, build and test, and 
deployment steps 700, 800, 900 and 1000. In this way 
enhancement that extend beyond the original scope of the 
product are developed much like a new product. 
System 

[0278] Those skilled in the art of process engineering will 
recognize that various embodiments of the CMM in a BOX 
method 10 described above may be implemented in various 
ways. For instance, the organization may use a set of written 
templates directing the implementation of the tasks in the 
CMM in a BOX method 10. 
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[0279] In one implementation, the present invention may 
be implemented as a computer application that prompts an 
organization for various inputs regarding its operation and 
structure. Using these inputs, the application then creates a 
series of task lists to implement the CMM in a BOX method 
10 of the present invention. The application may further 
create a record of task lists, so that the organization may 
easily document its actions as required in the CMM and 
CMMI. Alternatively, the program may provide templates 
through which the organization may document its activities. 
[0280] In particular, those skilled in the art will recognize 
that various embodiments of the CMM in a BOX method 10 
described above may be implemented using a combination 
of both electronic hardware and software. Referring to FIG. 
11A, a CMM implementation system 1100 receives user 
input 1130 and produces a business organization plan 1140 
based on the user input 1130. The system 1100 may be, for 
example, a personal computer (PC), a server, or any other 
computer device used for such purposes. The system 1100 
may be coupled to a database 1120 containing information 
on the organization and its suppliers. In this embodiment, the 
system 1100 has an organization management module 1110, 
a program management module 1112, a project management 
module 1114 and a delivery management module 1116 for 
implementing organization management 100, program man- 
agement 400, project management 500, and delivery man- 
agement 600. 

[0281] If the computer device 1100 is, for example, a 
network server, in electronic communication with an elec- 
tronic network, then users 1160 may be able to use the CMM 
system 1100 remotely. Referring to FIG. 11 B showing the 
computer device of FIG. 11A in electronic communication 
with a network 1150. The network 1150, may be, for 
example, the Internet, an intranet, an extranet, a Wide Area 
Network ("WAN"), Virtual Product Network (VPN) and the 
like. Users 1160 may transmit user input data 1120 to the 
CMM system 1100 via the electronic network 1150 then 
obtain a business organization plan 1140 based on the input 
data 1130. 

[0282] In another embodiment, the CMM system 1100 
illustrated in FIGS. 11A-B, may be a software application 
designed to operate over various hardware and computer 
systems, as known in the art. 

[0283] Turning now to FIG. 12, one embodiment of the 
present invention implements Method 10 of FIG. through 
the use of an accelerated process improvement framework 
system (APIF) 1200 including an enterprise document man- 
agement system (EDMS) 1210. The EDMS 1210 is a 
software application that permits multiple users to store, 
retrieve, and manipulate electronic documents on a closed 
client/server architecture network, such as a local area 
network (LAN) or wide area network (WAN). Known types 
of EDMS 1210 include DOCSFusion, available from 
PCDOCS, Inc., Toronto. Ontario, Canada and Enterprise 
Document Management in the Documentum Suite available 
from Documentum. Inc.. of Pleasanton, Calif. (http://www- 
.documentum.com). The configuration of these and other 
document managers function in connection with the tech- 
niques of the present invention, and the operation of which 
will be apparent to one of ordinary skill in the art in view of 
this disclosure. 

[0284] The EDMS 1210 generally includes a digital 
library repository that creates a document space, which may 



use a replicated infrastructure for document storage. The 
repository stores a document as an object that encapsulates 
the document's content along with its attributes, including 
relationships, associated versions, renditions, formats, work- 
flow characteristics, and security. These document objects 
can be infinitely combined and re-combined on demand to 
form dynamic configurations of document objects that may 
originate from any source. In this way, the document space 
supports organization of documents via folder and cabinet 
metaphors and allows searching over both document content 
and attributes. The document space also provides check 
in/checkout-style version control, full version histories of 
documents, and annotations (each with its own attributes 
and security rules), and supports workfiow-style features 
including notification of updates. 

[0285] Continuing with APIF 1200 in FIG. 12, the EDMS 
1210 connects to and administers one or more file storage 
devices 1220. The file storage devices 1220, such as various 
magnetic and optical storage media, are well known tech- 
nologies and are commonly commercially available. Alter- 
natively, the file storage devices 1220 may be on other LANs 
and WANs, or may be Storage Area Networks (SANS) or 
other network-based storage structures. The file storage 
devices may therefore be positioned at potentially great 
distances from the user. The user connects to these distant 
storage devices 1220 via various combinations of connec- 
tions, networks, webs, intranets, internets, the Internet, etc. 
(not illustrated) that are well known in the field of computer 
communications. For example, the Documentum Suite 
includes a DocControl Manager that runs on top of the 
Documentum repository to permit secure management of 
controlled documents over the Web. Using the DocControl 
Manager, authorized users may instantly access and view 
documents using the browser or viewer of their choice. The 
DocControl Manager thereby allows users to create, review, 
revise, approve and distribute controlled documents online 
within an audited environment. In place of elaborate manual 
processes, users may employ the DocControl Manager to 
create a Web-driven knowledge chain that links discon- 
nected processes for collecting, sharing, and applying 
knowledge to meet stringent quality goals and compliance 
requirements. 

[0286] In the present invention, the file storage device 
1220 contains files 1222 that store data relating to one or 
more steps in Method 10 (FIG. 1). Thus, when performing 
a step in Method 10, a user may select a file 1222 corre- 
sponding to that step. The file 1222 may then provide the 
user with the information and instructions needed to accom- 
plish that step. For instance, the file may direct the user to 
undertake certain quality control actions during the devel- 
opment of a software application. The file 1222 may further 
specify documentation that must be completed by the user 
during the step. In this way, a user may perform Method 10 
of FIG. 1 by opening one or more files 1222, following the 
actions specified in the files 1222, and then, when appli- 
cable, completing required documentation specified in the 
files 1222. The file 1222 may alternatively instruct the user 
on the relationship of that step with other steps in Method 
10. In doing so, the file 1222 may direct the user to other, 
subsequent steps in Method 10 by directing the user to files 
1222 corresponding to these subsequent steps. 

[0287] Returning to APIF 1200 in FIG. 12, a document 
management tool (DMT) 1230 may operate in conjunction 



US 2006/0235732 Al 



34 



Oct. 19, 2006 



with the EDMS 1210. The DMT 1230 maintains and tracks 
documentation needed for the method being implemented by 
the user. Documentation is important in many steps of 
Method 10 because it allows the user to subsequently verify 
completion of required actions, which the various CMM 
certifying bodies require before certifying that an organiza- 
tion has achieved higher levels of the CMM. The DMT 1230 
works in conjunction with the EDMS 1210. 

[0288] In particular, the DMT 1230 allows a programmer 
to associate required documentation with files 1222 corre- 
sponding to steps in Method 10. A linking attribute may be 
added to each document object stored within the EDMS 
1210 to facilitate association of the documents with objects 
in the process control system. Once a user selects and opens 
a file corresponding to a step having required documenta- 
tion, the DMT 1230, working together with the EDMS 1210 
may automatically present to the user an appropriate docu- 
mentation form. The DMT 1230 may also present completed 
examples to assist the user in completing the documentation. 
In this way, APIF 1200 helps the user to complete the 
necessary documentation for satisfying the requirements for 
certification. 

[0289] Alternatively, APIF 1200 may prevent the user 
from selecting other files 1222 that lead to additional steps 
in a process until Ihe required documentation for the current 
task is completed. This function may be accomplished by 
altering the document permissions maintained by the EDMS 
1210 so that the user cannot access certain files until various 
conditions are satisfied. While the EDMS 1210 continues to 
administer storage and retrieval of files, the DMT 1230 
affects the ability of the user to access some files until certain 
conditions are met, i.e., completion of the required docu- 

[0290] Turning now to FIG. 13A, a document workspace 
screen 1310 from an EDMS 1210 is shown. In particular, 
document workspace screen 1310 shows multiple soft "file 
cabinets," wherein each "file cabinet" stores a different 
category of documents. In the typical operation of the 
EDMS 1210, a user may provide an input specifying one of 
the files 1222 on the document workspace screen 1310. In 
general, the user may perform a mouse click to select a 
particular file 1222. In FIG. 13A, the document workspace 
screen 1310 lists several files in the right hand space that are 
identified by the DMT 1230 as required documentation. As 
specified above, these files may contain blank forms for the 
user to complete, instructions aiding the user in completing 
the forms, or examples of completed forms to which the user 
may refer when completing the blank form. 

[0291] Continuing with FIG. 12, APIF 1200 may further 
include a navigator tool 1240 that graphically presents to the 
user the steps in Method 10 or other processes. In this way, 
the EDMS 1210 may be configured to further support 
integration of document management with a process control 
system. In particular, the navigator tool 1240 creates dis- 
plays using the data contained in the files 1222 based on the 
user's inputs. For instance the navigator tool 1240 be an 
application to create HTML pages whose contains are deter- 
mined by information in the files 1222. Likewise, the HTML 
pages may contain hyperlinks to the information in the files 
1222. The navigator tool 1240 generally functions through 
the use of navigator data 1250. In a preferred implementa- 
tion the navigator data 1250 is an XML data file containing 



information on file names, file types (or template), whether 
the file is a standard or modified template, the files' loca- 
tions, and other information specified by the user. Alterna- 
tively, the navigator data 1250 may be a source table in a 
database or other type of data storage structure. Then, when 
creating the display, the navigator tool 1240 may access the 
appropriate file 1222 by referencing the navigator data 1250. 
The navigator data 1250 may be stored by the EDMS 1210 
along with the files 1222. If the files 1222 are positioned on 
a WAN, LAN; or SAN, the navigator data 1250 may be 
stored on this network as well. 

[0292] The use of the navigator tool 1240 is illustrated in 
FIGS. 13B-13J. As depicted in a login screen 1320 in FIG. 
13B, a user, after logging into the EDMS 1210, may select 
different processes including, but not limited to, Method 10. 
Thus, it should be appreciated that the navigator tool 1240 
may be integrated with the EDMS 1210 to assist the user in 
implementing various other projects and processes other 
than Method 10. 

[0293] Once the user selects a process to implement, the 
navigator tool 1240 accesses the EDMS 1210 to graphically 
display the selected process. After the user selects a project, 
the respective project page appears with the project name in 
the tool bar. The look and feel of the page produced by the 
navigator tool is generally similar lo a standalone HTML 
Help-based tool. If only one project existed for the EDMS 
1210, the user may be would be taken directly to that 
project's home page (i.e., navigator screen 1330 described 
below), avoiding the login screen 1320. 

[0294] Turning now to FIG. 1 3C, a navigator screen 1330 
contains a high-level, graphical depiction of Method 10 and 
generally displays the stages in Method 10. Each of the 
stages in the navigator screen 1330 may be hyperlinked to 
more specific information on the stage. Thus, the user may 
obtain further infonnation and/or start implementing one of 
the stages in Method 10 by selecting a box corresponding to 
mat stage. Continuing with FIG. 13C, the navigator screen 
1330 also graphically displays the relationship between the 
steps in a process so that the user may discern information 
about the steps, such as their order and interrelation. The 
navigator screen 1330 further contains, on the left column, 
an index of the steps and stages so that the user may easily 
navigate between steps in the process. This ability is par- 
ticularly valuable in processes such as Method 10 that 
potentially require the user to simultaneously perform mul- 
tiple actions. 

[0295] As illustrated in FIG. 13D, a user's selection of 
one of the steps in the high-level process display in the 
navigator screen 1330 leads to a detail navigator screen 1340 
containing more detailed infonnation on the selected step. 
Specifically, the detailed navigator screen 1340 lists the 
individual actions to be undertaken and the documentation 
to be completed by the user in that step. As with the 
navigator screen 1330, the detailed navigator screen 1340 
graphically displays the relationship between various 
actions and documentation. For instance, the user may see 
that a certain action must be undertaken before a document 
may be completed and that other actions may not be initiated 
until completion of the document. Again, one or more of the 
boxes in the detailed navigator screen 1340 may be hyper- 
linked to more specific infonnation contained in the files 
1222. 



US 2006/0235732 Al 



35 



Oct. 19, 2006 



[0296] For instance, the user's selection (or clicking) of a 
documentation box causes the navigator tool 1240 to pro- 
vide more information on that documentation. Specifically, 
the user's selection of a box to compose a document leads 
to a documentation screen 1350. as displayed in FIG. 13E. 
The displayed documentation screen 13S0 may contain 
various information, including a description of the document 
to be created, an indication of the step(s) of Method 10 
associated with the document, and samples of the document 
to be created. As indicated in the top center, the documen- 
tation screen 1350 in FIG. 13E may further contain "but- 
tons" or hyperlinked boxes that allow the user to start 
composing the document (or "deliverable"), to. search for 
existing documents by type, and search for existing docu- 
ments by file storage location. 

[0297] If the user selects the button to compose a docu- 
ment or an equivalent thereof, the navigator tool 1240 
produces a composition screen 1360, as illustrated in FIG. 
13F. The composition screen 1360 presents to die user a 
template for the document. The composition screen 1360 
generally allows the user to select a template for the docu- 
ment to be created and to specify a name for this the created 
document. In one implementation, a defaulted storage loca- 
tion, or "path." for the deliverable is determined according 
to the project and die template type. Specifically, a particular 
type of documents created for a project may be stored at a 
particular location. This feature allows the user to easily 
locate other examples of a document. When the user selects 
a template for a document, the navigator tool 1240 produces 
a template screen 1370, as displayed in FIG. 13G, to 
provide instruction and information to the user regarding the 
creation of the document. 

[0298] The user may also select the "View By Type" 
button in the documentation screen 1350 of FIG. 13E. This 
selection causes the navigator tool 1240 to create a list of all 
documents of a specific type (e.g., documents created from 
the same template) that are stored by the EDMS 1210. For 
instance, the type search screen 1380 in FIG. 13H displays 
files related to "project standards procedures policies." In 
this way, the user may locate examples of a document, even 
if these examples are associated with a different project or 
mediod or are located in different file storage locations. 
Conversely, the user may select the "View By Location" 
button in the documentation screen 1350 of FIG. 13E. In 
response, the navigator tool 1240 works with the EDMS 
1210 to create a list of documents at the specified location. 
As described above, similar documents related to a specific 
process are typically stored in single location. Searching 
files at a particular storage location thus generally allows the 
user to examine similar documents pertaining to the same 
project. In the location search screen 1385 in FIG. 131, the 
navigator tool 1240 displays files related to "project standard 
procedure policies" located at the path/project one/stage 
one/step one/document one. If the user knows the name and 
location for a file, the user may subsequently locate and view 
the file using the EDMS 1210, as depicted in the search 
screen 1390 in FIG. 13K. 

[0299] In another embodiment, as depicted in FIG. 14, a 
multiple repository APIF system 1400 distributes the docu- 
ments needed for the Method 10. As described above, these 
documents include, for example, instructions for implement- 
ing the Method 10 and documentation to evidence actions 
taken in the Method 10. The multiple repository APIF 



system 1400 has a navigator application 1460 (described in 
greater detail below) that allows a user on the client-side to 
access documentation and data from multiple data reposi- 
tories 1440 through a server 1410. The data repositories 
1440 may have different formats and protocols and may be 
located at different locations. For instance, the data reposi- 
tories 1440 may be: (1) PVCS or other well known systems 
of version control and configuration management software; 
(2) a LAN; (3) an information sharing application, such as 
Sharepoint® by Microsoft Inc. of Redmond, Wash., that 
gives users the ability to organize information, readily 
access that information, manage documents, and enable 
efficient collaboration; or (4) the above-described EDMS 
application such as the Documentum. 
[0300] The server 1410 generally includes Active Server 
Pages (ASPs) 1420. ASPs 1420 is a specification for a 
dynamically created Web page with a "ASP" extension that 
utilizes ActiveX scripting, generally a VisualBasic Script or 
JavaScript code. When a browser requests an ASP page, the 
server 1410 generates a page with HTML code and sends it 
back to the browser. The operation of the ASPs 1420 is 
described in greater detail below. 

[0301] The server 1410 further includes a database engine 
1410. The database engine is well-known technology for 
organizing, locating, and accessing data contained in the 
data repositories 1440. Examples of the database engine 
include Oracle®, SQL Server®, and Access®. 
[0302] The components in the server 1410 use Web-based 
Distributed Authoring and Versioning (WebDAV) techonol- 
ogy 1450 to coordinate with the different data repositories 
1440. WebDAV 1450 is an extension to HvperText Transport 
Protocol (HTTP). Specifically, WebDAV 1450 adds new 
HTTP methods and headers and specifies how to use the new 
extensions, how to format request and response bodies, how 
existing HTTP behavior may change, etc. 

[0303] HTTP is the standard mechanism by which infor- 
mation is transported over TCP/IP (Transmission Control 
Protocol/Internet Protocol) compatible networks, such as the 
Internet, intranets, and extranets. A protocol specifies what 
occurs in the connections between a client and a server. 
Basically, the protocol specifies data formats and algorithms 
so that the client and server can interoperate. HTTP is more 
specifically an application-level protocol for distributed, 
collaborative, hypermedia information systems. It is a 
generic, stateless, protocol that can be used for many tasks 
beyond its use for hypertext, such as name servers and 
distributed object management systems, through extension 
of its request methods, error codes and headers. It is referred 
to as a transport protocol, since information is transported 
according to its specifications, and is also referred to as a 
request-response protocol, since information is exchanged 
by a client making a request of a server, which generates a 
response thereto. 

[0304] A common use of HTTP is the transport of infor- 
mation formatted according to a markup language. For 
example, a popular application of the Internet is the brows- 
ing of world-wide-web pages thereof. In such instances, 
typically the information retrieved is in HyperText Markup 
Language (HTML) format, as transported according to 
HTTP. However, other standard markup languages are 
emerging. One such markup language is extensible Markup 
Language (XML). XML describes a class of data objects that 
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are referred to as XML documents, and partially describes 
the behavior of computer programs that process them. A 
primary difference between HTML and XML is that within 
the former, information content is intertwined with the 
layout of the content, making their separation difficult, for 
example. Conversely, within XML a description of the 
storage layout and logical structure of content is maintained 
separate from the content itself. However, both XML and 
HTML are subsets of a markup language known as Standard 
Generalized Markup Language (SGML). 

[0305] HTTP, and hence XML in the context of HTTP, 
allows for the access of resources. The term resource refers 
to any piece of information that has a location described by 
a Uniform Resource Locator (URL) of the form HTTP:// 
<domain>. <extension>, where <domain> specifies a par- 
ticular domain, and <extension> can be, for example, .com, 
.edu, and net, among others. A resource can be, for example, 
a Web page, a document, a database, a bitmap image, or a 
computational object. 

[0306] Extensions to HTTP allow for, among other things, 
the setting and retrieval of properties for resources. A 
property is specifically a name/value pair that contains 
descriptive information about a resource. More generally, a 
property is any information about a resource. Thus, proper- 
ties provide for the ability to create, remove, and query such 
information about resources, such as their authors, creation 
dates, etc. Properties also provide for the ability to link web 
pages of any media type to other related web pages. 

[0307] The goal of WebDAV 1450, broadly speaking, is to 
add remote authoring capabilities to HTTP, so that HTTP 
can be more convenient as a readable and writable collabo- 
rative medium, and not necessarily only a browsing medium 
for web pages. To achieve this goal, WebDAV allows an 
extended uniform set of functionality to be attached with 
documents available through a web server. Thus, the Web- 
DAV 1450 protocol allows Web clients to create and edit 
documents over the Web. WebDAV 1450 also defines col- 
lections and a mechanism for associating arbitrary properties 
with resources. WebDAV 1450 also provides a means for 
creating typed links between any two documents, regardless 
of media type where previously, only HTML documents 
could contain links. 

[0308] WebDAV 1450 may operate as a remote file system 
with extra properties. Specifically, WebDAV extensions may 
be used to specify an access control list (ACL), a set of data 
that informs a computer's operating system which permis- 
sions, or access rights, that each user or group has to specific 
system objects, such as directories and file. Each object can 
then have a unique security attribute that identifies which 
users have access to it, and the ACL is a list of each object 
and user access privileges such as read, write or execute. 

[0309] WebDAV 1450 works with the file access system in 
an operating system, such as the Windows Explorer® in 
Microsoft Windows (D to allow a user to seamlessly access 
a remote storage device. 

[0310] Returning to FIG. 14, the operation of the multiple 
repository system 1400 is now summarized. In operation, a 
user at the client side uses the navigator application 1460 to 
access or create a document. The navigator 1460 works with 
Internet Explorer® browser. For instance, to access and 
view a document, the user provides some type of input (such 



as clicking on a desired button) to the navigator application 
1460 to specify the document to be viewed. Based on the 
input, the navigator 1460 forwards information to the server 
1410 identifying the document, such as name or type of the 
document, the software project of interest, and the name of 
the server storing the document. In response, one of the 
ASPs 1420 accesses the database engine 1430 to locate the 
document named in the request. Then, ASP 1420 then 
connects the user to appropriate the data repository 1440 via 
WebDAV 1450. Typically, the user may view a web folder 
displaying the contents of the data repository 1440, from 
which the user mav select a desired document via WebDAV 
1450. 

[0311] Similarly, to compose a document through a stored 
template, the user specifies the document to be created 
through the navigator application 1460. In turn, the naviga- 
tor application 1460 forwards to the server 1410 information 
identifying the document. For instance, the navigator 1460 
may forward the name of the document, the project of 
interest, and server storing the document. In response, one of 
the ASPs 1420 accesses the database engine 1430 to locate 
the desired template. The ASP 1420 further creates an entry 
in the database engine 1430 for the document to be created. 
The name of the template is then used to build a location for 
the template, typically in the form of a URL. One of the 
ASPs 1420 then copies a template from the data repository 
to a target folder using WebDAV 1450. An ASP 1420 then 
forwards a page to the navigator 1460 displaying the target 
folder with the new document. The user may then open the 
document through the navigator 1450 to view and edit the 
template. The navigator 1460 may then forward the docu- 
ment to one of the repositories 1440 via WebDAV 1450. The 
database engine 1430 then stores the location for the stored 
document. 

CONCLUSION 

[0312] The CMM method of the present invention has 
been empirically shown to allow organizations to achieve 
higher levels of CMM hierarchy much more rapidly. On 
average, an organization or a project within an organization 
takes about three years to achieve compliance with level 3 
of the CMM. In contrast, several projects implementing the 
CMM in a BOX method 10 of the present invention have 
reached level 3 of the CMM in an average of nine months. 
These results suggest the utility and benefit of the present 
invention in assisting organizations to achieve higher levels 
of CMM maturity. 

[0313] The foregoing description of the preferred embodi- 
ments of the invention has been presented for the purposes 
of illustration and description. It is not intended to be 
exhaustive or to limit the invention to the precise form 
disclosed. Many modifications and variations are possible in 
light of the above teaching. For instance, the method of the 
present invention may be modified as needed to meet the 
requirements of new versions of CMM and other maturity 
models as they are developed. It is intended that the scope 
of the invention be limited not by this detailed description, 
but rather by the claims appended hereto. The above speci- 
fication, examples, and data provide a complete description 
of the manufacture and use of the composition of the 
invention. Since many embodiments of the invention can be 
made without departing from the spirit and scope of the 
invention, the invention resides in the claims hereinafter 
appended. 
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TABLE 1 



The SEPG Project Plan se 



The Decision Analysis and Resolution 
(DAR) reference document defines DAR 
and its value, explains the purpose of DAR, 
identifies typical decisions requiring DAR, 
describes DAR techniques and artifacts, and 
provides guidelines for selecting the 
appropriate DAR technique. It also 
specifically outlines the process that all 
projects must follow when performing DAR. 

informs project tea 



le lor r< 



Resources 
Control SEPG 
Project Work 



Communication 
Toolkit 



be performed, the estimated effort required, 
key completion dates. They are produced at 
the project planning time: either at the end 
of a preceding phase of work, or during the 
project definition process. This will be the 
basis for the project's approach and staffing 



Risk Management Template 



The Communication and Sponsorship Plan 
Toolkit documents the instructions and 
areas of consideration for tile 

m and Sponsorship Ph 
jn and Sponsorship PI; 
serves as a guide to the communicat 
sponsorship efforts throughout the di 

The Communication and Sponsorship Plan 

sponsorship efforts diroughout die duration 
ot the project. It is a living and working 
document and should be updated 

The Configuration Management Plan 
applies to all information systems and 
related system engineering activities that 
might affect the achievement of a project's 
effort. This would include hardware, 
software, and documentation. In particular, 
the focus of this plan is on the enterprise 

TJusplan identifies the need for a 
configuration management function that will 
maintain focus on the overall technical and 
functional objectives of the program. This 
enterprise configuration management 
function will also provide the continuous 

ss capabilities. Implementing 




Plan SEPG 
Hxeciition 



on SEPG 
ol SEPG 
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TABLE 1 -continued 



Orientation Binder Template 



reducing risk. All projects must perform risk 
planning in order to achieve Risk 
Management Planning objectives. Large 

Management Plan, lint smaller projects 
need only to incorporate their risk planning 
into the Project Plan. 

The Training Needs Matrix lists the required 
training by role on a project, and describes 



training required to fulfill their roles. 
The Orientation Binder acts as a key sou 
of information for a new team member. 1 
topics and information provided within tl 
binder will help the new member get 
acquainted with the project's pmpose. 



Projects are required t< 



The SEPG Project Processes & Policies 
Table of Contents documents the project's 

formalized policies, standards, and 

standards, and processes that the project is 
required to develop 

This Project Processes & Policies documen 
that arc specific to a project. Such 



Process, Risk Tracking Process, New 
Process Definition Process, al! development 
and testing procedures, etc. See attached 
samples as a starting point for developing 
project-specific processes. 
See fust occurrence of Navigator Item. 



Control SEPG 
Project Work 
Organize SEPG 

Resources 



Organize SEPG 
Resources 



CMMI 
for Spons 
Training 



The CMMI Awareness Training is a 
presentation designed to help training 

li i ii I the CMMI frame I 

and its benefits, understand CMMI Level 2 

CMMI Level 3 concepts and examples. This 
Training pertains to the Capability Maturity 
Model - Integrated (CMMI) framework. 
CMM in a Box is based on the CMMI 

The CMMI Awareness for Sponsors Training 
is a presentation designed to help sponsors 

benefits, understand CMMI Level 2 
concepts and examples, and understand 
CMMI Level 3 concepts and examples. 
The SEPG Program Over 



Organize SEPG 
Resources 



Organize SEPG 
Resources 



elp the t 



The Quality Reviews Trai 
attendees with a definitior 
the Software Quality Assi 
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TABLE 1-continued 



Navigator Item 



Management Plan 
(shaded for update) 



SEPG Stage. 
See first 
occurrence of 
Navigator 
Item at the 

SEPG Stage. 



Organize SEPG 
See first 



at the Process 
Plan and 
Organize SEPG 



Matrix ^shaded for 



Navigator Item 
Plan and 



The purpose of this Service Level 



Metrics Workbook 



project and the Software Engineering 
Process Group (SEPG). This document i: 
pre < led l Liic proj t m a i .vho m 



The Ta 



:s. The SEPG will 
a copy of the Service Level 
it to the Engagement Partner, 
s the responsibility of the Project 
to distribute/educate project team 



ii the co 



,-icw of 

n of SEPG efforts, 
oring & Waiver Request template 
guidance on how a project can 



process, deliverable, and tool tailoring. Ai 
reviewing the guidelines, if your project 
determines that a waiver request form is 
required, please complete the waiver 



The Project Metrics Workbook template is 

required'by the Project Team. The project 
must complete the Metrics Workbook on a 
monthly basis and submit it to the SEPG 
team lead. The Metrics Plan oudines the 
overall metrics program and provides 



The Metrics Plan describes the overall 
approach for identifying, collecting, and 
n:i] ■ fog delivery metrics. Projects must 

The purpose of the document is to provide 
inionnation on how to demonstrate each 
best practice by KPA (Key Process Area). It 
includes references to templates, job aids 
and samples deliverables. 



Rollout & 



Rollout & 

Support 

Projects 



Rollout & 



Project Plan Project 

Management Execution 
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TABLE 1 -continued 



summarize the project. This memo should 

metrics including schedule and budget plan 

project shortcomings^ 
The Software Quality Assurance (SQA) 
Debrief is conducted at the end of the 
project. During this meeting, the Software 
Engineering Process Group (SEPG) project 
manager gathers metrics on the 
effectiveness of the SQA process for the 

of the SQA Debrief are used to continuously 



Process Rollout & 



Super SQA Training Training 



Schedule Sample 



Participant List Sample 
Assessment Sample 



The Super SQA Reviewer Training is a 
presentation designed to help the SQA 
Reviewer trainee understand and articulate 
the Super SQA Process, 

involved in a Super SQA Review, and be 
able to participate in a Super SQA Review. 
1 , 11 Quality issur.m c QA 
Report lists deviati 




development processes back to the 
Capability Maturity Model - Integrated 
(CMMI). This schedule sample outlines a 
generic OSP agenda. 
The Logistics Sample document can be 
modified to create a logistics checklist for 
the organization's assessment. It includes 



st for the 



nt Preparation Training 
Sample provides an outline that includes the 
Assessment Purpose & Overview, Roles & 
Responsibilities, Interviews Do's & Don'ts, 
Process Assets, Interview Questions, 



Process Conduct 



Process Conduct 



Process Conduct 



Process Conduct 



Mini-Appraisal Plan Template 



participants as they prepare for 

The purpose of this plan is to outline the of a 
mini-appraisal process for the organization. 
This plan documents the goals, objectives, 



Process Conduct 
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TABLE 1-continued 



Core Competencies Template 



Guiding Principles Template 



expected outcomes, scope, p 
schedule, and logistics of the evaluation. It 
also specifies the tailoring of the Standard 
CMMI Assessment Method for Process 
Improvement method for the purposes of the 
mini-appraisal. 

The Process Improvement Survey should be 
distributed to all participants to gather 
information regarding their experience with 
the Software Engineering Process Group 
(SEPG). The information gathered from this 
survey should be used as an input in 
improving the processes of the Software 
lg Group, 
he Organization Design and 
Development (OD&D)Toolkit is to help 
create, modify, and/or develop organization 

needs. Depending on the scope of the 
organization design and development 



d to facil 



dl of the h 



planning, designing, and implementing 
organization design changes. This toolkit 
includes detailed information for each step 



he OD&D Toolkit 

:s for many of the steps. Use the 
' ng point for 



sample core competencies that will be 
developed as part of the Organization 
Design and Development process. A 

knowledge, skills, and other 

performance on a job. Below is a list of 
.Formore 



Organization Design and Development 
Toolkit. 

The Guiding Principles should be produced 
through discussions with members of the 
organization to reflect the current operation 



Conduct 
Quarterly 



Personnel Determine 



Design & 

Development 

Toolkit 



Think of them as tips on how to 
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TABLE 1-continued 



definitions, and the required 



problem-solving compet< 
The purpose of this doct 
process of role design th 



Strategy. 
Design 



d in the Organization 
nt Toolkit 

ited roles that defines 



The organization design in 
tasked with creating the preliminary job 
at. The final job de 



Design 

Organization 

Infrastructure 



Design & Document 

Development 

Toolkit 



Preliminary Job 
Description (shaded 
for update) 



Customer/Industry- focused. 
Identify Organization Strategy. 



See first occurrence of Navigator Item in 



See first occurrence of Navigator Item in 
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TABLE 1 -continued 




ss objectives of the 
organization. The Performance 
Measurement Toolkit does not apply to 
individual measurement. Please refer to th 



Design & 

Development 

Toolkit 



Identify Organization £ 



Navigator 
Identify 



J I i I t will licit n 1 I 
deliver training to the audience(s) who will 
use newly identified processes. This will 
help people to perform rlieir roles effectively 
r ' Bacilli 1 ' ii i i e !i 



1 mi, i pi ; 



ss for cl 



Training Needs 

Analysis 

i .a i PI i, 
Design Training 

Training 

Denver framing 



i trai i i del Inn I 1 i 



affected training audiences. It includes a 
high level training needs analysis by 
audience or group and a more detailed 

See first occurrence of Navigator Item in 
Conduct Training Needs Analysis. 



See first 
Navigator 



The Training Plan course is used to prepare 
instructors how to teach a particular course. 
It includes training approach, co 



Personnel Develop 



Item in in Conduct 

Conduct Training Needs 

Training Analysis. 



al design and development 
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TABLE 1 -continued 



Tie objective of the Program Business 
Case Approach is to define the process for 
identifying, estimating, documenting, and 
submitting project initiatives for the 
upcoming year. First, it defines the process 
by which the next year's projects are 
identified. Second, it defines a process to 
ensure that all costs and benefits associated 

jiner. Third, it 



ise of comparison 



Case Approach and the Progi un Bu ine 
Case Sample. This document is to be used 
as a template for building a business case 
while the Program Business Case Sample 

actual Business Case should look like. This 

bailment should Lx- u ! Lb In 

does not have an existing and well-defined 
Business Case. In cases where a Business 
Case already exists, use. the existing 



The Prof, 



Management Approach 
ument describes the various 
1 approaches that can be used 
:ig trie program office. This 



Justify Program 
Control 



Performance 
Reporting Approach 



and general responsibilities of a program 
office. This document should be used for 
guidance when developing the Program 
Plan. 

The Program Plan defines the overall 



planning phase, this document serves as a 
roadmap for running the program. It 
includes all major management functions 
such as program organization, quality, 
metrics, and reporting. 
Performance Reporting involves the 

overall program and each project's 
performance and progress against die plan. 
Project status reporting and team member 
ritical functions within 



se of this 



deliverable is to develop the Performai 
Reporting process and to record any fu 
changes in direction, scope, or timefrai 
This document defines the financial coi 
and processes for the program, includii 
financial management and reporting. 
The Program Resource Management PI 
defines the method for sourcing and 



Resources 
Control 
Program Work 
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TABLE 1 -continued 



Stage Step 



The Program Release Management 
Approach is a set of guidelines that cover 
the management approach for defining, 
planning and delivering releases. Release 
management is responsible for defining and 



Program Plan Program 



re particularly 
jrograms of 
ill 



Program 

Management 

Approach 

Program Resource 
Management Plan 
(shaded for update) 



Management 
Approach 



Program Business 
Case (shaded for 



Program 

Management 

Approach 



approach. The actual release strategy and 
the definition of the releases themselves fo 
a given program are contained in the 
Release Plan, which is a separate, program 

See first occurrence of Navigation Item, 



The purpose of the Program Resource 

includes request specifications, role and 
responsibilities requirements, resource 
preparation, and request approval. When 
completing the Performance Resource 
Request, the Program Manager should 
review the Program Management Approach 
for input into the request process. 



;e of Navigation Item. 



The Program Closeout Report documents 
the closure of the program. It includes 
details of the final disposition of all hum! 



occurence 
Program 



occurrence of 
Navigation 
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TABLE 1 -continued 



st Practices Referei 



Tailoring & Waiver Template 



Process Group (SF.PG). This do 
presented to the project manager wno mil 
agree to and sign before a substantive 
SEPG support commences. The SEPG wi 



while it is 



icEnt :m 
tribute/educj 



Level Aj 
estimated tin 
execution of SEPG efforts. 
The purpose of the document is to provide 
information on how to demonstrate each 
best practice by KPA (Key Process Area). 
It includes references to templates, job aids 
and samples deliverables. 
The Waiver Request and Tailoring template 
provides guidance on how a project can 
tailor the methodology to better suit their 
needs. It includes guidelines on policy, 
process, deliverable, and tool tailoring. After 
reviewing the guidelines, if your project 

request form using the "Compose 



Decision Analysis 



The Project Plan serves as a guideline for 
on a project. It also identifies the key project 



The Decision Analysis and Resolution 
(DAR) reference document defines DAR 
and its value, explains the purpose of DAR, 
identifies typical decisions requiring DAR, 
describes DAR techniques and artifacts, and 
provides guidelines for selecting the 
appropriate DAR technique. It also 
specifically outlines the process that all 

In addition, the DAR re" 



le for resolving and 



The Work Plan describe the key 
deliverables to be produced, the aci 
be performed, the estimated effort 
key completion dates. Tl 

of a preceding phase of work, o 
project definition process. This 1 
basis for the project's approach 



produced at 
at the end 
during the 



Management 



Control Project 
Work 



sponsorship efforts throughout the duration 
of the project. It is a living and working 
document and should be updated 
periodically as audience needs change. 
The Communication and Sponsorship Plan 



US 2006/0235732 Al 



49 



Oct 19, 2006 



Type Desertion St* Step 

K™. est 




US 2006/0235732 Al 



50 



Oct. 19, 2006 



TABLE 1 -continued 



Project Pro. 
& Policies 
Contents 



The Project Processes & Policies Table of 
Contents documents the project's formalized 
policies, standards, and processes. It also 



Navigator 



and procedures that are specific to a project. 
Such document i nd i 
Tracking Process, Risk Tracking Process, 
New Process Definition Process, all 



generally problems th; 



All Stages 



Navigator It 



Risk Management is the process of recording, 



Agenda/Minutes Template 
Individual and/or Template 



Management St! 



Training Needs 
Matrix (shaded for 

Requirements 
Traceability Matrix 
(shaded for update) 



situations that could occur and if they do, they 
would have a significant impact on the project. 
Projects should track al minimum the nature of 
the risk, the impact, mitigation approach and 

The Meeting Minutes/ Agenda documents the 
purpose and content of a meeting, as well as 
any key meeting outcomes and action items. 

team member, or for the entire team. This will 
list accomplishments for the week, tasks for 
next week, issues, and other information that 

The Project Status Report summarizes project 
status and reports on project metrics, key 
milestones, effort, issues and risks. 
The Configuration Management Status Report 

project management. The CM status must be 
reported to project management on a periodic 
basis as established in the CM Plan. 



1 record the discrepancies and the 

Tective actions for those discrepancies. The 

;cribe the project information, lists the 
nponents audited, and lists the findings 
ulting from the audit. All discrepancies 



Project Control Pi 



See first See first 



Analysis Stage. 
Project Control Project 
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(Shaded for Update 

Project Plan 
(shaded for 

Closing Memo 



resolved or answered prior to 

complete. Completing the 
ts and issues to consider 

will prove beneficial 



additional 
during nej 

in clarifying the table 



3 f Navi 



Navigator Item. 



versus actual, project successes, and project 



The Software Quality Assurance (S 
Report lists deviations in standard t 
and deliverables as listed on the O 



The Business Case provides economic 
justification for the change journey and for 
i 1 ii 1 i i i 



Business Case address 



The Current Business Assessment allows f 
reviewing of the existing system. This mal 
it possible to identify potential reusable 



Manageme 
Complete 



See first 
Navigator Item. 



(shaded for update) 
Peer Review 



le proposed solution. 

ss flows, ant 



should map to the application interface 
requirements and ultimately to the 
requirements traceability matrix. 
The New Business Assessment deliverable 
identifies the number of users per location that 
will be using the application. It is required for 
estimating hardware and software needs. 
See first occurrence of Navigator Item. 



Moved to Peer Review design m. 



Peer Review 
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Moved to Commit design m. 



Application and 
Requirements 




Traceabiiity Matrix lists 
its from stakeholders that the 
■eds to fulfill. Stakeholders can 
ers, customers, suppliers, other 



Identify and 

Application and 

Requirements 
Control Project 
Work 



User and Service 



The Execution/Operations Aj 

that support the solution. It is an intermediate 
layer between the application and the 
operating system software. The 
Execution/Operations Architecture 
Requirements de 



The Technology Selection Matrix categoriaes 
requirements for the techn 
lists options for satisfying each requirci 
category and lists the recommended sol 



The Techno 



Execution/Operations Template 
Component Design 



of a graphical representation of the scope of 
the technology infrastructure. It depicts the 
technology components that make up 
technology infrastructure and will ultimately 
support the solution, including links to external 

The Technology Blueprint provides a high- 
k 1 ie\ I 1 techni I in i ti . n 
necessary to enable the business objectives. 
This document should outline the general 
design forth, 
operations en 

The 

Component Design de 
sub-processes and interlaces necessary 
component to meet the specified 
requirements. The design covers custoi 

component extensions for the 
execution/operations architecture. A 



Technology 
Infrastructure 



Analyze 

Technology 

Infrastructure 
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A ■ hit dure 
Select and 



ctions that are clean unambiguous and 



Execution/Operations 
Architecture Test 



The Execution/Operations Architecture test 
Results describe the achial results of the test 
and any issues or lessons learned from the 



Architecture Test 



The Execution/Operat 



Technology Template 
Blueprint 

(Shaded for update) 



; of 

Navigator Navigator Item. 

Design Select and 

Development 



nt Architecmre Physical Mod' 
shows the actual components comprising the 
development architecture and their relative 
location and interfaces. Interfaces across 
Id also be reflected (e.g., 



Select and 

Development 
Architecture 
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This Delive 
stages involved in testing. A Testing 
Approach consists of Test Objectives and 
Scope, Test Overview. Deficiency Tracking 
Approach, Regie-, ion Testin n cl 
it, and Risk M 



The Development Architecture Test Plan 
documents die specific steps in the testing 

processes or passes, the cycle definitions, the 

testing database and configuration 

The Development Architecture Test 



Select and 

Development 
Architecture 



Build and 
Test 

Design 



requests, data exchange and control, backup 
and recovery requirements, error handling 
procedures, and provides escalation 
procedures in the event of a conflict 



Conceptual Design 



identified. The scripts an 



The Development Architecture Test Results 
describe the actual results of the test and any 
issues or lessons learned from the test effort. 



The Development Architecture Test Data is 

The data is used in conjunction with the tes 
scripts to validate that the conditions are be 



The Conceptual Design < 
called the operational^ 
key functional and i 



rk product. This document add 
the design method, functional and dat 
requirements, screen design, report de 
interfaces, and data conversion at a hi 
The details will be expanded later in 
general design and detailed design 



Build and Test 

Technology 

Infrastructure 



Build and Test 

Technology 

Infrastructure 



Technology 
Infrastructure 

Application 



Interface Template 



work Units, Modules are packets of grouping 
all the information necessary to code a portion 
of an application. It also provides a graphical 
display of the logical components of a module. 
Items displayed include Inputs, Outputs, 
Functional Description, and Interfaces. 
The Interface 



tcrfacc 



ss the t 
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The Interface Design Approach is used to 
outline the process of transferring data in an 



interface processes and record information 
about the processing of those interfaces. 
File Transfer - A method to transfer the file 



Error Processing - The process of capturing 
Restart/Recovery - The ability to restart an 



backup and recovery i 
The Assembly Test PI. 
specific steps in the te 



Assembly Test Template 



Assembly Test Data Template 



database and configuration management for 

The Assembly Test Conditions describe the 
conditions by which the component will be 
tested. The conditions map directly to the 
licati iiii Mil 

The Assembly Test Scripts define the steps to 
be followed by the testing executor to test the 
conditions that have been identified. The 



The Assembly Test Results describe the 
actual results of the test and any issues or 
lessons learned from the test effort. 



smbly Test Data is the data used : 
et accurately ai 



Application 
Architecture 
Build & Test Build and Test 



Architecture 
Build & Test Build and Test 

Application 
Design Design 

Application 

Architecture 
Build & Test Build and Test 



Database Definition 



This document supports the logical data 
model and describes the entities and 
attributes for the logical data model. 
Defines the details of the actual database 
installation configuration including sizes and 
locations for databases. 
This document identifies a database, which 
makes up part of the Physical Database 
Design. It captures the key aspects of the 



tables, indexes, views, and tablespaces. 
Optionally, it may include description of the 
disk configuration, sizings, placement, and 
segment management strategies. Create this 



se Space Template 



ce requirements for a database. The 



appropnal 
requirements are based on the type of 
database defined. In on ' 
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database space requi 




or (DBA) or 



document is typically cr< 
.Analyst or Database Admini 
Data Administrator (DA). 
This document describes the rational for the 

'I i I d.imb.1 gn b efinii li 
Tablespace of this database and should give 
context to the database so technical staff can 
se design. Use this 



Strategy, Data Partitk 



r- mi iti %m II outline the rollout segment. 
Data conversion will be covered by identifying 
what data needs to be converted, along with 
outlining the procedures that will be followed 
in converting that data and the controls that 
will be in place to ensure the quality and 



Operations 
Detailed Desigr 



uce system information into tarj 
mation will also be included. 

inology Infrastructure design 



The Execution/Operations Ar 
Detailed Design is used to document the 
detailed design specifications for the 
execution architecture components. 
The Execution/Operations Architecture Guide 
is a spreadsheet that tracks the inventory of 



See first 



Navigator Item 
on Design 
Technology 
Infrastructure 

Execution/ 



Build and Test 

Execution/ 

Operations 
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API Documentation 



Typically API documentation comes from the 
vendor. If API's are developed internally 
proper coding standards should be followed. 



Navigator Iten 
Technology 



Execution/Operations Template 



Design Technology Infrastructure design 



Navigator Iten 
Technology 



occurrence of 
Navigator Item 



Navigator It 




Development 
Architecture Test 

(shaded for update) 



Technology 
Infrastructure 



Navigator Item 
Technology 



Techno^ 
Infrastrut 



Navigator Item 
in Design 
Technology 
Infrastructure 
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Template See fiist occurrence of Navigator Item in 



(shaded for update) 



Design Technology 

Technology Infrastruchue 

Infrastructure design matrix. 

See first See first 

occurrence of occurrence of 

Navigator Navigator Item 



policy and procedures deployment, workforce 



Build & Test Deployment 



Operations Manual Template 



Id & Test Deployment 



Disaster Recovery Template 



availability and security. 



Build & lest Deployment 



iii T iiij I i 1 



The Deployment Test Plan documents the 
flan specific steps in the deployment test process. 

It includes descriptions of the test processes 
or passes, the cycle definitions and entry and 

Deployment Test Template The Deployment Test Conditions describe the 

Conditions conditions by which the component will be 

The condition p dirccl tl 



The Deployment Test Results describe 
actual results of the test and any issue 
lessons learned from the test effort. 



input to test the conditions. The data is used in 
conjunction with the test scripts to validate that 
the conditions are being met accurately and 
as required. 

The Online Detail Design provides an 
overview of the components necessary for 
online development. It contains information 
would need to successfully 



■b. This v 



Build & Test Deployment 

Deployment Activateand 
Verify 

Deployment 
Build & Test Deployment 

Planning 
Deployment Activate and 

Verify 

Deployment 
Build & Test Deployment 



& Test Deployment 



Verify 
Deployment 
& Test Deployment 
Planning 



; of lib 



A document describing expected 
1 space to provide actual results will 
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The Report Detail Design provides an 

creating reports. There exist nol r tl 
programmer, including general design 
changes. There are process flows that 
describe how the reports are created, such as, 
where the information comes from that 
populates the reports, the format of the report 



re produced (daily, weekly, monthly, etc.) 



Stored Procedures Template 
Shells Template 



The Interface Detail Design provides an 
overview of the Int< " 
their functionality. There ex 
flow that visually shows 



functionality, how it recei 



r, the names of stored 
procedures that may be. used; and any issues 
that need to be known. 




The Component Test Data is th 



:d procedures or functions so that all code 
rdized format, 
is developed for the project 



Build & Test Perform 

Application 
Detailed Design 



Build & Test Build & Test 
Application 

Build & Test Perform 

Application 



1 & Test Build & Test 

Application 
I & Test Perform 

Application 

ild & Test Build & Test 
Application 

Id & Test Perform 

Application 
Detailed Design 

id & Test Build & Test 
Application 

Id & Test Perform 

Application 
Detailed Design 
Build & Test Build & Test 

Application 
Build & Test Perform 



Build & Test Build and Test 
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(Navigator Item) Type 



Component Test Template See first occurrence of Navigator Item. 

Plan 

update) 

Test Template See first occurrence of Navigator Item, 

shaded for update) 

Component Test Template See first occurrence of Navigator Item. 



of Navigator Item. 



Component Test Template See first 

I for update) 

Component Test Template See first occurrence of Navigator Item. 

I for update) 



Assembly Test Template See first oc 

Conditions Design Application design m 

(shaded for update) 



1; 1 I template ee In I i 

Scripts(shaded for Design Application design m 



Application 



Navigator Ite 

Navigator Ite 
Application 



Assembly Test 
(shaded for update) 



of occurrence of 



ce of Navigator Item in 



occurrence c 
Navigator ID 



Procedures 



procedures, or step-by-step instructions ft 

application steps, documented in job aids 
and/or online quick reference (OLQR) to. 
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Product Test Plan Template 



ycle definitions, the phase 



& Test Prepare & 

Application 
Product Test 



ct Test Template 



tested. The conditions map directly to the 
application and interface requirements. 
The Product Test Scripts define the steps 
be followed by the testing executor to tes 



Id & Test Prepare & 



Product Test Data Template 



learned from the test efl 
The Product Test Data i 



Build & Test Prepare & 

Application 
Product Test 
Build & Test Prepare & 



See first See first 



Management 
stage design 



SIRs/CRs Template 



The User Acceptance Test Results describe 
the actual results of the test and any issues oi 
lessons learned from the test effort. 

The User Acceptance Test Data is the data 



Build & Test Prepare & 



Build & Test Prepare & 



Build & Test Test App 
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Deployment Test Template 
Conditions (shaded 
for update) 



Build & Test App design m 



navigator navigator item 

item on the on the Build & 
Build & Test Test App 



Deployment Test 
Scripts (shaded for 



navigator navigator item 

item on the on the Build & 
Build & Test Test App 



Deployment Test 
Data (shaded for 



Id & Test App design m. 



of navigator item on the 



Selection Criteria 



The Sign-off document contains the 

ures of the project manager and project 
3r (client), ini 




Statement of Work 



Management Management 
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Subcontractor 
Selection Criteria 
(shaded for update) 



See first occurrence of na 



Stage Step 



It presents the status of a subcontractor's 

level. It summarizes status of the task ordi 
and provides more detailed information fo 
incidents, scope impacts and deliverable 
schedules only when project management 



information. The status report cannot require 
the subcontractor to provide st itu- repc rtm - 



Project Management stage design m. 



Supplier Control 



navigator 



The Product Selection Approach provides :m 
approach that the project will follow to select 
the best fit product (i.e. software, hardware) 
for Che project. The approach will cover the 
following key tasks: (1) identify and list viable 
products from the marketplace, (2) narrow the 
list to a handful of finalists based on screening 
criteria, and (3) select the best iluti < ,ti 



et to become a final candidate, such as tile 
desired high-level functional, technical, 
vendor, and quality criteria for products. 
These criteria will be input to the RFI, RFP 
and vendors will be screened against these 
criteria and against each other. Once the long 
list of vendors and products have been 
screened and reduced to a short list, the 
criteria will be refined to define the selection 
criteria upon which the final product will be 



Supplier Organize 
Agreement Product 
Management Acquisition 
Tasks 



the project. This document should be used 
describe the key scenarios in which the 
product will have to perform. The dociimc 

product "finalist" against the scenarios. 
The Product Acceptance Test Plan docume 
the specific used by the project to test the 
product prior to final ac 



Acqulsitioi 
Tasks 
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Performance Test 



The Product Acceptance Te 
describe the co 
will be tested. The co 




The Product Acceptance Te 
describe the actual results of tie test and any 
issues or lessons learned from the test effort. 
The Product Acceptance Test Data is the data 
used as input to test the conditions. The data 

validate that the conditions are being met 
accurately and as required. 
The Product Performance Test Plan 
documents the specific steps used by the 



Control Product 



Management 



Control Product 



Control Product 



Performance Test 



Performance Test 
Performance Test 



component will be tested. The conditions map 
directly to the product selection criteria. 
The Product Performance Test Scripts define 
the steps to be followed by the testing 
executor to test the conditions that have been 




Agreement 
vl lit Lgemenl 



Management 



The Tracking Tool Installation Guide outlines 
the steps to take when installing any of the 
various tracking tools including the Issues, 
Risk, and SIRs/CRs tools. 
The SEPG Project Processes & Policies 
document is used to record standards and 
procedures that are specific to a project. Such 
documents would include the Issue Tracking 
Process, Risk Tracking Process, New Process 
Definition Process, all development and 
testing procedures, etc. See attached 
samples as a starting point for developing 
project-specific processes. 

presentation designed to help training 
attendees understand the CMM framework 
and its benefits, understand CMM Level 2 
concepts and examples, and understand 



Organize SEPG 
Resources 
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CMM Level 3 concepts and examples. This 
Training pertains to the Capability Maturity 
Model (CMM) for Software only, not to CMM- 
Integrated (CMMI) 

framework. This (raining does not covex 

the CMM for Software. CMM in a Box is 
based on the CMMI framework. 
The CMM to CMMI Transition Training is a 
presentation that focuses on the transition 
from the Capability Maturity Model (CMM) for 
Software to CMM - Integrated (CMMI). The 
training provides generic examples of the 



CMMI requ 
The CMMI 



: transition from Capability 
el (CMM) to Capability Maturity 
rated (CMMI) and how the new 
:ments are being implemented 



for Sponsors Training 
is a presentation designed to help sponsors 
understand the CMMI framework and its 
benefits, understand CMMI Level 2 concepts 
and examples, and understand CMMI Level 3 
concepts and examples. 
This purpose of the Tracking Tool Design 



Process Organize SEPG 

Resources 



ce purposes only. T 



■st (SIR) & 
on the page for 



Tailoring & Waiver 



Do not download or save from this page, go to 
the Project Management Stage if you need a 
copy of this document. The purpose of this 
Service Level Agreement is to define the 
service level and communication requirements 
between a project and the Software 
Engineering Process Group (SEPG). This 

substantive SEPG support commences. The 
SEPG will distribute a copy of the Service 
Level Agreement to the Engagement Partner, 
while it is the responsibility of the Project 
Manager to distribute/educate project team 

Agreement provides an overview of estimated 

SEPG efforts. 



Rollout & 



the Project Management Stage if you need a 
copy of this document. 
The Tailoring & Waiver Request template 
provides guidance on how a project can tailo 
the methodology to better suit their needs. It 
includes guidelines on policy, process, 
deliverable, and tool tailoring. After reviewin 
the guidelines, if your project determines tha 
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Metrics Workbook 



a waiver request form is required, please 
complete the waiver request form using the 
"Compose Deliverable" option above. 
This document is included on the page for 

rete I j l 1 [ mj 

responsible for completing these documents. 
Do not download or save from this page, go to 
the Project Management Stage if you need a 

The Project Metrics Workbook template is 
used as a central repository for the metrics 
required by the Project Team. The project 
must complete the Metrics Workbook on a 
monthly basis and submit it to the SEPG team 
lead. The Metrics Plan outlines the overall 
metrics program and provides detailed 
explanations for each metric included in the 

This document is included on the page for 
reference purposes only. The projects are 
responsible for completing these documents. 
Do not download or save from this page, go to 
the Project Management Stage if you jieed a 



Rollout & 




ze the project. This memo should 
iroject results, pertinent project 
tncluding schedule and budget plan 
ctual, project successes, and project 



the Project Management Stage if you need a 
copy of this document. 
The Software Quality Assurance (SQA) 
Debrief is conducted at the end of the project. 
During this meeting, the Software Engineering 
Process Group (SEPG) project m 
gathers metrics on the ef~ ' 
SQA process for the project an 



Rollout & 



Rollout & 




This sample c 
Organizational Structure Types and provides 
samples of each. These include Ftinctional, 
Process, Product, Matrix, and 
Customer/industry-focused. 

The Balanced Scorecard should be used to 
integrate financial and operational measures 
within the organization as a means to focus 
management on strategy and vision. The 
Balanced Scorecard documents a set of 
me; t 
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(Navigator Item) Type 



Management 



TABLE 1 -continued 



Perspectives, Objectives, Metrics, Targets. 
The purpose of the Project Management 

(Key Process Area). It includes references to 
templates, job aids and samples deliverables. 
See first occurrence of Navigator Item in the 
Organizational Management Plan & Organize 
SEPG design Matrix 



softheSQADebrie: 



organizational Organizational 



G design design Matrix 



Management Project 



in Process Template 



ae the rollout segment, 
le covered by identifying 

ffi that will be followed 
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What is claimed: 

1. A system for accelerating process improvement, the 
system comprising: 

a data storage device for storing one or more files related 
to a method for accelerating process improvement, the 
method comprising a step for managing an organization 
developing a product, a step for managing a project for 
developing said product, and a step for managing the 
delivery of said product; and 

a data management system for administering said files. 

2. The system of claim 1 wherein said mediod further 
comprising a step for managing a program for implementing 
said method. 

3. The system of claim 1 wherein one of said files contains 
information related to creating a document associated with 
said method. 

4. The system of claim 3, wherein said information 
includes instructions on creating said document. 

5. The system of claim 3, wherein said information 
includes an example of said document. 

6. The system of claim 1 further comprising a document 
management tool, wherein said document management tool 
associates a document with a step in said method. 

7. The system of claim 1 further comprising a navigator 
tool for graphically displaying one or more steps in said 
method. 

8. The system of claim 7 further comprising navigator 
data related said files, said navigator data used by said 
navigator tool. 

9. The system of claim 1 further comprising: 

a plurality of data storage devices; 

and said data management system for administering said 
files further comprising a server wherein said server 
includes a database engine for storing the location of 
said files. 



10. The system of claim 9 further comprising a navigator 
application that accepts an input from a user identifying one 
of said files and connects the user to that file. 

11. The system of claim 10 wherein the server uses 
WebDAV to allow said user to connect to said plurality of 
data storage devices. 

12. A method for accelerating process improvement, the 
method comprising: 

storing data related a step for managing an organization 
developing a product, a step for managing a project for 
developing said product, and a step for managing the 
delivery of said product; and 

administering said data using a document management 
system. 

13. The method of claim 12 further comprising: 

associating a document with one or actions in said step for 
managing an organization developing a product, said 
step for managing a project for developing said prod- 
uct, or said step for managing the delivery of said 
product. 

14. The method of claim 12 further comprising: 

graphically displaying one or actions in said step for 
managing an organization developing a product, said 
step for managing a project for developing said prod- 
uct, or said step for managing the delivery of said 
product. 

15. The method of claim 12 wherein the said data is stored 
on a plurality of data repositories and further comprising the 
step of allowing a user to access said data repositories using 
WebDAV. 
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